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PREFACE 


There is a pronounced need of a book on advanced calculus that 
does not sacrifice rigor to such an extent as to become ineffectual 
as an instrument for developing a critical attitude toward analyti¬ 
cal proeasses, and yet which is sufficiently concrete tft be useful 
to a student with one year of preparation in the calculus. I am 
^Mer no delusion that this volume completely fills this need, 
t T shall feel generously repaid for my efforts if it should prove 
) J jme aid to those who are faeed with the perplexing problem 
> iStniction in analysis. 

■ In preparing this book I have made every effort to keep in 
iWnd the difficulties of the reader who is encountering for the 
Irst time a serious body of mathematical doctrine. Some ideas 
4hat are innately (fifficult, but whose basic sources stem from 

■ *>metry, are presented first from an intuitive point of view, 
^ that the essentials can be grasped at once. I did not think 
I wise to include rigorous arithmetical proofs of such theorems 
i those on convergence of bounded monotone sequences (Sec. 6), 
% theorem of Bolzano-Weierstrass (Sec. 7), the theorem of 
*1 ^rboux (Sec. 36), and a few others. This is in accordance with 
t e precept that the most effective means of thwarting interest 
; mathematics is by misdirecting rigor. A reader who is suffi- 
0 *ntly sophisticated to feel the need of arithmetical proofs of 

I se theorems will find them in the treatises to which I refer 

I I the text. The material contained in this volume is so arranged 
s to minimize the need of irksome references to matters to be 

.iblished later on. No difficult and essential proofs have been 
I legated to exercises to be worked out at the reader’s leisure. 

’’he subject of advanced calculus is not an easy one, and the 
I 'king of the problems is essential to a mastery. There are 
; nerous illustrative exercises and problems scattered through¬ 
out the fext to aid the reader in gaining an insight into the beauty 
and the wide range of applications of analysis. A student with 
a good background in the calculus will be able to read this book 
without omissions. 



vi PREFACE 

A considerable portion of the material included here represents 
a transcription of the lecture notes that I have used from time to 
time in my classes. These notes place me under some obligation 
to many of the existing books on analysis, especially to the 
masterpieces of Goursat, Knopp, and de la Valine Poussin. I 
am also much indebted to my wife, who not only undertook the 
arduous task of reading the manuscript in its various stages, but 
who also aided me immeasurably with the correction of the proof. 
Her assistance has resulted in many essential improvements. 

Ivan 8. Sokolnikoff. 

Madison, Wis., 

November j 1939. 
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CHAPTER I 

LIMITS AND CONTmUITY 

1 . Number System. This section consists of a brief summary 
of the concepts and properties of the system of numbers that will 
be considered in this volume. The starting point is the system 
of positive integers. This system permits the operations of 
addition and multiplication but proves inadequate to permit 
the solution of many simple linear equations. Thus, if a, h, 
c, and d are positive integers, a + x = h and cy = d do not 
possess solutions that are positive integers unless b > a and d is 
an integral multiple of c. The first equation serves as the defini¬ 
tion of the new number zero if 6 = a and of the negative integers 
if b < a. The second equation demands the introduction of 
d 

the fractional numbers — 
c 

The system of numbers consisting of the positive and negative 
integers and fractions and zero is called the system of rational 
numbers. It admits the four fundamental operations of addition, 
subtraction, multiplication, and division (except by zero). More¬ 
over, it is ordered,^’ which means that if a and h are two different 
numbers, then a > & or 6 > a. Also, if c is a third rational 
number and a>h and 6 > c, then a > c. The system of 
rational numbers possesses the additional property of density , that 
is, between any two different rational numbers there is always 
another rational number (and, therefore, an infinite number of 
rational numbers) that is greater than one of the numbers and 
less than the other. 

A further extension of the number system is required when it 
becomes necessary to solve equations of the second and higher 
degrees. In elementary algebra a rational number is defined as 

one that can be expressed in the form (6 7^ 0), where a and 6 


1 
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are integers, and an irrational number is defined as one that does 
not possess this property. The irrational numbers include not 
only such numbers as \/2, ->^ 4 , etc., which arise in the 
solution of algebraic equations, but also v, e, etc. The method of 
introducing the irrational numbers, which is outlined below, is due 
to Dedekind.* 

Assume that all the rational numbers have been separated into 
two sets in such a manner that every number in the first set is 
less than every number in thei, second set. A separation of this 
type is called a cut, - or partition, (French, coupure; German, 
Schnitt) of the number system. Four cases present themselves, 
but it is easy to see that one of these is impossible. They are: 

i. The first set. A, contains a greatest element a and the second 
set, B, contains a smallest element b. It caimot be that a = b 
since every element of A is less than every element of B. But 
if a < 6, then there are rational numbers which are greater than 
a and less than b (by the property of density). These numbers, 
being greater than a, must belong to B, and at the same time, 
being less than b, must belong to A, which is impossible. 

ii. A contains a greatest element a, and B contains no smallest 
element. For example, let A consist of the number 2 and all 
rational numbers less than 2, whereas B consists of all rational 
numbers greater than 2. 

iii. B contains a smallest element b, and A contains no greatest 
element. For example, let B contain 2 and all rational numbers 
greater than 2 , and A contain all rational numbers less than 2 . 

iv. A coflitains no greatest element, and B contains no smallest 
element. For example, let A consist of all the negative rational 
numbers and all positive rational numbers whose square is less 
than 2, and let B consist of all the positive rational nupibers whose 
square is greater than 2. Then the cut defines the irrational 
number -\/ 2 - In general, let the system of rational numbers be 
separated into two sets A and B in such a way that every number 
in A ie less than eoery number in B and A contains no greatest 
element and B contains no smaUest element. Then the cut defines 
an irrational munber that has the property of being greater tjian 
all the elements in A and less than all the elements in B. 

The system of numbers that includes all the rational numbers 
and all the irrational numbers is called the real number system. 

* Steti^eit und inationale Zahten, Bramisehweig, 1872. 



§2 


LIMITS AND CONTINUITY 


The fundamental operations of addition and multiplication and 
the inverse operations of subtraction and division are defined for 
irrational numbers in such a way* that the system of real numbers 
possesses the commutative, associative, and distributive prop¬ 
erties. Moreover, if the product of any two real numbers is 
zero, then at least one of the numbers must be zero. 

It is often desirable to have a correspondence between the 
real numbers and the points of a straight line, so that analytic 
methods can be applied to geometry. In order to effect a one-to- 
one correspondence, it is necessary to assume the axiom of Cantor’- 
Dedekind, which states that “to each point on the line there 
corresponds one and only one real number and, conversely, to 
each real number there corresponds one and only one point on the 
line.”. 

As is already familiar from elementary algebra, the solution 
of the general quadratic equation + 6a; + c = 0, in the case 
where the discriminant 6^ — 4 ac is negative, necessitates the 
introduction of a new type of number of the form u + iv, where u 
and V are real numbers and i is a number such that = — 1 . 
Such numbers are called complex nvmbers. The system of com¬ 
plex numbers includes the system of real numbers (as a special 
case when v = 0), and the fundamental operations must be 
defined so that they are consistent with those already in use for 
real numbers. This can be done by considering the complex 
numbers in the form u -H iv or by treating them as ordered pairs 
(u, v) of real numbers. Since this volume deals primarily with 
real numbers, these definitions and the properties of complex 
numbers will not be discussed here.f 

2 . Sequences. Let some process of construction yield a 
succession of real numbers 


Xi, X2, Xz^ Xny 

where it is assumed that every term Xi is followed by other terms. 
A succession of numbers formed in this way is called a sequence 

* Db la ValiJb PoxrssiN’, C. J., Cours d'analyse infinit^iimale, voL 1, 
pp. 1-8; Fine, H. B., College Algebra, pp. 39-66; Hobson, E. W., Theory of 
Functions of a Beal Variable, voL 1, pp. 20-34. 

tSee Db la ValuSb Poussin, C. J., Cours d'analyse infinit^simale, 
vol. 1, pp. 37-42; Fine, H. B., College Algebra, pp. 70-78; Bubkhabbt, H., 
and Rasor, S. E., Theory of Functions of a Complex Variable, pp. 1-23. 
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and is denoted by the symbol {x,}. The individual terms of the 
sequence {aii} are called the elements of the sequence. 

Examples of sequences are 

(o) 1 , 2 , 3 , 4 , • • • , n, • • • ; 

(6) 1 , - 2 , 3 , - 4 , . . • , (-1)“-% •••; 

. V 1 1 1 1 / 1X„ 1 

2 ’ i’ 8' 16 ' ■ ' ■ ’ ^ 2’*' 

(d) 0,1,0,1, ■ • • , MU + (-1)"], • • • ; 

(e) 2, 3 , 5 , 7 , 11 , • • • , • • • . 

It is not essential that the general term of the sequence be given 
by some simple formula, as is the case in the first four examples 
above. The sequence (e) represents the succession of prime num¬ 
bers, and p„ stands for the nth prime number. There is no 
formula available for the determination of the nth prime number, 
but it is possible to calculate all prime numbers less than any 
given number iV. Although the process of constructing the 

Ps _ Pz Pi 

Jfj h Xi Xi 

Via. 1 . 

sequence (e) is much more complicated than the processes used 
for the other examples, nevertheless it yields a definite succession 
of numbers. 

It is convenient to represent the elements Xi of the sequence 
{*(} by points on a straight line. The points Pi are so chosen 
that the distance from an arbitrary point 0 of the line to the 
point Pi is equal to Xi. In this way a correspondence is estab¬ 
lished between the elements of the sequence {a:;} and a set of 
points on a straight line. To avoid circumlocution, the elements 
Xi of the sequence will be called points, instead of saying that they 
are numbers such that the distances of the points jP< corresponding 
to them, from some fiducial point 0 , are equal to Xi (Fig. 1). 

In studying the behavior of sequences of real numbers, or sets 
of points corresponding to them, several interesting cases present 
themselves. It may happen that one can find a positive number 
M such that the inequality 

l^nl s: M 
or 

— M ^ Xn ^ M 
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is satisfied for every n, however large. In such a case the 
sequence {a;,} is said to be hounded, A geometrical interpreta¬ 
tion of this circumstance is that the points corresponding to the 
elements of the sequence always remain within a segment of 
length 2M with the point 0 as the midpoint of the segment. 

As an example, consider a succession of values 


12 3 4 
2 ' 3 ' 4 ' 5 ' 


. .^ 

' ^ n + 1^ 


It is clear that, no matter how large n is taken, 


IXn! 


n 

n + 1 


< 1, 


so that the sequence |( —is bounded. 

The sequences (a), (6), and {e) (p. 4) are unbounded, but 
any number greater than or equal to will serve as a bound for 
the sequence (c), and any number greater than or equal to unity 
is a bound for (d). 

A sequence {a;*} is called a null sequence if subsequent to the choice 
of a 'positive number e, however small, one can find a positive integer p 
such that \xn\ < e for all values of n > p. 

If a graphical mode of representing the sequence by points 
on a straight line be adopted, the definition of the null sequence 
means that the points P^+i, Pj^-a, • . • , corresponding to 
Xpjf. 2 , . . . , will all lie within the interval of width 26 with the 
point 0 as midpoint. 

, It. is important to observe that the integer p in the foregoing 
definition is determined after the choice of the number e has been 
made, and hence, p depends on the magnitude of €. To clarify 


this, consider the sequence 



or 


i 1 i. 

V ' 22' 32' ' * ’ n* 

This sequence is a null sequence, since one can always find an 
integer p such that for all values of n greater than p 
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n2 > 

Hence, if one chooses for p any positive integer greater than the 
number the inequality will be satisfied. If € is chosen as 

HoOj any integer greater than 10 will serve as p; but if € *= 
p must be chosen greater than 100. 

PROBLEMS 

1. Show that is a null sequence. 

is a null sequence. Show that n must be 

chosen greater than logio^ in order that the inequality \zn\ < « be 
satisfied. 

3. Limit of a Sequence. Convergence. If is a given 
sequence and there exists a number L such thal the sequence {xi — I/} 
is a null sequence^ then the given sequence is said to be convergent and 
the elements Xi of the sequence are said to approach the limit L, 
Recalling the definition of the null sequence, it is clear that if 
the limit of the sequence {xi} is L, then corresponding to any 
positive number e, a positive integer p can be assigned such that 

\L — Xn\ < €, for all n> p. 

The last statement is frequently written in the following ways: 

lim Xn I/, 

n-+ ao 

or 

Xn L, 

when n—* CO. The symbol n » is read “n tends to infinity." 

It is cleax that a null sequencS.is a convergent sequence with 
the value zero as the limit of the sequence. Moreover, it is obvi¬ 
ous that every convergent sequence is bounded.* 

• The converse of this etatement is not true. Thus, the sequence 
0,1,0,1,0, . . . is bounded but not convergent. 


Prove that 
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The following theorem regarding null sequences is established 
easily: 

Theorem. If the terms of any null sequence 

* ’ * j • 

are multiplied by a sequence of bounded factors 

aij a^j as, • • • , fln, • * • , 

then the resulting sequence 

OiXx, 02X2, a^Xz, • • * , dfiXn, • • • 

is a null sequence. 

Since the numbers Un are bounded, there exists a positive num¬ 
ber Mj independent of n, such that 

(3-1) |an| < M. 

Moreover, since the sequence {xi} is a null sequence, it is possible 
to find for every € > 0 a positive integer p such that 

(3-2) |Xnl < 

whenever n > p, Multipl 3 dng the inequalities (3-1) and (3-2) 
gives 

janXnl < 

which establishes the fact that the sequence {unrcn} is a null 
sequence. 

Inasmuch as the notion of the limit of a sequence is one of the 
basic concepts of analysis, it is desirable to consider an example. 

Illustrative Example. Let the variable x assume a set of 
values 


Xx — 0 . 3 , X 2 — 0 . 33 , Xz ^ 0 . 333 , • • • • 
It will be shown that 


lim Xn = 

eo 


that is, corresponding to an arbitrary « > 0, one can determine 
a positive integer p, such that the difference 
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\l ~ a:«l = IK - *n| 

becomes and remains less than e for all values of n > p. 

Note that 

1 _ 1 - _ _ - 

3 “ 30’ 3 300’ ’3 3 ■ 10»' 

Now choose an e, and impose the demand that 

1 _ 1 ^ 

3 ~ 3 • 10 * 

But the inequality is equivalent to 

3 • 10" > 

€ 

and taking logarithms to the base 10 of both sides of this inequality 
gives* 

log 3 + ^ > log 7 ; 


or 

n > — (log c + log 3) = — log 3€. 

Thus, if p is chosen as any integer greater than |— log 3€|, the 
inequality will be satisfied for all values of n greater than this 
particular value of p. 

A geometrical interpretation of the statement 
lim Xn L 

is that all but a finite number of the points xt will fall within 
the interval of width 2 « about the point L. 

The totality of points whose distance from a given point L is 
less than a given number «is called a neighborhood of this point. 
The term vicinity is also used to denote the neighborhood. 

4. Inequality of Bernoulli, lim -v^ = 1. Let it be required 

to determine the limit of as n « by assuming the sequence 
of positive integral values and where a is any positive number, 

• It will be noted that if d. > JS, log A > log B. This fact follows directly 
from the definition of the logarithm. 
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This limit will be determined with the aid of an inequality estab¬ 
lished by James Bernoulli, which states that if x is any real num¬ 
ber such that 


a? > — 1 and a? 5*^ 0, 

then 

(1 -f a;)’* > 1 + nXj 

where n is any integer greater than unity. 

This inequality is obviously true if n = 2, since 

(X + xY = l+ 2x + x^>l-\-2x. 

The proof for any positive integral value of n will be established 
by the method of mathematical induction. Assume that the 
inequality is true for n = /c, and prove that then it is valid for 
n = A; + 1. Since the inequality is known to be true for n = 2, 
it will follow that it is true for n = 3 , 4, 5 , • • • . 

Assuming the truth of the inequality for n = that is, 

(1 + > 1 + fca?, 

then 

(1 + xy{l + a;) > (1 + *a;)(l + x) = 1 + (fc + l)x + kx^ 

> 1 + (fc + l)x, 

and the proof is complete. 

To show that lim = 1 for a > 0, consider the two cases: 

1. a ^ 1, 

ii. 0 < a < 1. 

i. If a = 1, the statement is obvious. 

If a > 1, ^a > 1, so that one can write it as 

(4-1) = 1 -f a:«. 

Hence, 

o = (1 -f 

and by the inequality of Bernoulli 


o = (1 -f *„)" > 1 + naj* > nx„. 
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Consequently, 


so that the numbers Xn form a null sequence, and it is seen from 
(4-1) that the sequence of numbers 

V^a—>•! as ra—>00. 

ii. If 0 < o < 1, then ^ > 1> and from (i) it follows that 


<«) -1} 

is a null sequence. If the terms of the sequence (4-2) are multi 
plied by the factors 

o, Vo, Vo, • • ' , Vo, • • • , 

there results the sequence 

{1 - V^}, 

which, by the theorem of Sec. 3, is a null sequence since the factors 
are bounded.* 


PROBLEM 

Find the limits of the following sequences: 


... 1 2 3 n - 


rM 2 3 4 
Q>) 

(c) 1,2*4' 


n-fl 
' n 
1 

J_ JL 

■ ■ ■ Wt" 


,. 1 1 
V2'V3 


6. Existence of the Limit. The definition of convergence of a 
sequence {«<} given in Sec. 3 implies the existence of the limit L, 

• The factors V® are bounded since a i Vo < 1. 
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since the application of the test, based on this definition, requires 
the knowledge of the limit L, 

The problem of the numerical calculation of the limit of any 
given sequence ordinarily is an exceedingly difl&cult one, but in a 
great variety of practical and theoretical investigations one is 
satisfied with knowledge of the behavior of the sequence as 
to convergence and does not require the numerical value of the 
limit. There is a profound theorem due to A. Cauchy that 
enables one to establish the existence of the limit of a sequence 
without actually calculating the limit itself. This important 
theorem is as follows: 

The Ftindamental Principle of Convergence. A necessary and 
sufficient condition for the existence of the limit of the sequence 
[Xn] is that for any c > 0 one can find a positive integer N such 
that for any pair of indices m and n, both greater than or equal 
to N, 

\Xtn €» 

It will be established first that the condition enunciated in 
the principle is a necessary one. Let the sequence converge, and 
denote its limit by L. Then for any positive e, however small, 
one can find a positive integer N such that 

(5-1) \L - a;n| < I 

whenever n N. But one can write 

Xfn — Xn == (Xn, — L) + (L — Xn) 

and, noting that the absolute value of the sum is less than or at 
most equal to the sum of the absolute values, one has 

\Xfn —Xn\ ^ \Xm - L\ + \L — Xn\ 


where the last step results from the hypothesis (5-1). 

The demonstration of the sufficiency of the condition is not so 
easy. An analytical proof makes considerable demands on the 
mathematical equipment of the reader,* but the correctness of 

* See Hobson, E. W., Theory of Functions of a Heal Variable, vol. 1, p. 38. 
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the converse of the principle can be seen from the following 
geometrical considerations, which in essence do not depart from 
a rigorous analytical proof. 

The hypothesis this time is that for any« > 0, 

( 5 “ 2 ) \^m 

whenever m and n both exceed or are equal to N, which, of 
course, depends on the magnitude of e. Choose e — and 
denote the corresponding value of N by Ni; then if pi is any 
index greater than Ni, 

l^n 

for every n > pv 

Geometrically this means that all points a:„ of the sequence 
for which n > pi lie within the segment of length unity which has 
as its midpoint (Fig. 2). 



^P» 

Pio. 2. 


If e is taken equal to there will exist an integer p* > px, 
such that for every n > ps 

l®« - ajj-.l < 

Then all points *», for n > pa, will lie within that portion of the 
segment of length with Xp^ as the midpoint, which is contained 
in the segment of length unity. Setting e => H, one is assured 
of the existence of an integer ps > pa, such that 

\Xn ~ aSy,] < 

whenever n > p*. That is, the inequality is satisfied for all 
points Xn that are contained in that portion of the interval of 
length with x,, as the midpoint, which is common to the 
interval of length Y with Xpx as the midpoint. 
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Contmuing this process by assigning to € successively the 
values etc., one builds up a sequence of intervals diminish¬ 

ing in length and such that the end points of these intervals tend 
to a definite point L, which is the limiting point of the sequence. 
Thus the existence of the limit L is demonstrated, provided the 
condition (5-2) is satisfied. 

The fundamental criterion of convergence is frequently 
stated in the following somewhat different, but equivalent, form, 
which the reader will have no difficulty in deducing. 

Theorem. A necessary and sufficient condition for the conver¬ 
gence of the sequence 

* * * j * * * 

is that for any € > 0, one can find a positive integer N such that 

when n Nj and for every positive integer k. 

It is seen from the foregoing that the significance of the criterion 
is, roughly, that all terms of the sequence for sufficiently large 
values of the indices lie arbitrarily near one another. 

In order to illustrate the application of the fundamental 
criterion, consider the sequence 

1 ; , 

where each term is the arithmetic mean of the two terms which 
immediately precede it. Thus the general formula for the nth 
term of the sequence (n > 2) is 

1 "f" 

Xn = 

It is easily seen that the difference between two consecutive terms 
of the sequence is 

^ (-1)" 

^n+l Xn -2n * 

But all the terms following Xn+i lie between Xn and Xn+i, and 
if any € > 0 has been assigned, one can choose a positive integer 
N so great that 
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With, thia choice of N the inequality 

^n| ® 

will surely be satisfied for any m and n that are not less than N. 
Thus, by the fundamental criterion, the sequence is convergent. 

As an exercise the reader may attempt to show by induction 
that 

- 1 _L 

3 ■ 2»-i’ 

so that the limit of this sequence is %, although one need not 
Jmow the limit itself in order to establish the convergence of the 
sequence. 

6. Criterion for Convergence of Monotone Sequences. The 
fundamental criterion of convergence is applicable to any type 

L M 

Xj Xjt Xjf Xjii 

I'lo. 8. 

of sequence, but if one is dealing with monotone sequences (that 
is, such that either Xn+i ^ Xn for all values of n or x^+i :S 
for all values of n), there is a simpler criterion that states that 
a monotone seqwnce which is hounded is convergent. 

In order to make this assertion plausible, assume the sequence 
(ajn} to be monotone increasing and bounded, that is, 

iCn+l ^ Xn, 

and |x»| < M for every value of n. Geometrically this means 
that the points corresponding to the elements Xn of the sequence 
move to the right with increasing values of the index n (Fig. 3) 
but are always restricted to lie to the left of the point correspond¬ 
ing to the number M. It is thus intuitively clear that there must 
be some point L ^ M toward which the points x% tend with 
increasing n. This point L is the limit of the sequence. 

The discussion in the preceding paragraph applies to the case 
of monotone decreasing sequences bounded on the left if the 
words right and left are interchanged. It should be remarked 
that the foregoing discussion is based on an intuitive notion as 
to what happens in a corresponding geometrical situation. A 
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rigorous analytical proof based on a refinement of this pictorial 
idea is omitted. 

To illustrate the use of this criterion of convergence of mono¬ 
tone sequences, consider the sequence where 

*1 = 

*2 = 

Xi = yi + 


1 

» +1 


^n + 2 


+ • • • + 


2n 


This sequence is monotone increasing since 

_ 1 1 ^ n 

2n + 1 2n + 2 ^ • 
Moreover, it is bounded for 


‘T + 


71 -f“ 1 w -f* 2 


+ 


+ 


271 


n ' 


71+1 


< 1 . 


Therefore, the sequence {ajn} is convergent. 

The power of this criterion lies in the fact that it requires only 
the proof of monotonicity and of the boundedness of the sequence. 
Accordingly, it is much easier to apply than the more general 
fundamental criterion. 

PROBLEMS 

!• Show that the sequence 

1 +1 ^ i + i’ ■ ■ ■ > ^ +5i + ■' • +' 
is convergent. 

2. Prove the convergence of the following sequences: 
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7. Divergent Sequences. Upper and Ix)wer Limits. Consider 
again a variable x that assumes a set of real values 


Xif Xzj j Xnf • 

and a set of points Pi, Pa, • • • , P», • • ■ associated with it. 
If the sequence {*„} fails to converge, it is said to diverge. 

The sequence may fail to approach a limit because the variable 
X becomes infinite, which simply means that one can find a posi¬ 
tive integer N such that for every n ^ N 

\Xn\ > M, 

where ilf is a preassigned positive number, however large. In 
geometrical language, the statement that x becomes infinite 
means that no matter how large a segment with 0 as the midpoint 
one may take, there will be points P„ that lie outside this segment. 
If the variable x becomes infinite in such a way that after some 
value, say %, it remains positive, it is said to tend to positive 
infinity. On the other hand, if it becomes and remains negative 
after some Xp, it is said to become negatively infinite or to tend 
to negative infinity. 

For example, if x takes on the set of values 
-1, -2, -3, -n, 

it becomes negatively infinite. This behavior is commonly 
denoted by writing 

lim *«=—<» 

n-+ 

but this notation is bad since in this case the limit does not 
exist. It should be kept clearly in mind that the mark » is 
not a number but a symbol representing the idea that the variable 
X increases without limit. 

The variable x may also change in such a way that it neither 
approaches a limit nor becomes infinite. For example, if x 
assumes a sequence of values 


1—11 —1 • • • 

X, X, Xy X, I 
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it is clearly bounded, but instead of approaching a limit, it 
oscillates between +1 and —1. 

In defining the limit L of a sequence {a:*}, it was stated that 
the inequality 


\L — Xn\ < € 

must be fulfilled for every value of n > p, regardless of how 
small the number € is chosen. A geometrical interpretation 
of this statement is that an infinite number of points Pi, cor¬ 
responding to the elements Zi of the sequence, lie in every interval 


-+-14 


ti:! 




1 


-2 


-I 


/ V4 3/i 


Fiq. 4. 


of width 2e whose midpoint P corresponds to the limit L of the 
sequence. Accordingly, the point P may be called the point 
of condensation or the limiting point of the sequence {li}. 

Points of condensation may arise even if the sequence {xj} 
is not convergent. For example, the sequence 


(7-1) 


„ 3 4 5 6 

2’ 3’ 4’ 5' 




n 


does not converge, but there are infinitely many elements of 
(7-1) in the vicinity of the points —1 and +1. Any interval of 
width 2€ (Fig. 4) about a;=—lora;=+l contains infinitely 
many terms of the given sequence, so that the points —1 and +1 
are limiting points of the sequence (7-1). 

The points of condensation are of considerable importance 
in the study of the so-called power series* 

Definition of Limiting Poiii$. A number L is called a limiting 
point of a sequence {x*} if for any € > 0 there is an infinite number 
of terms of the sequence satisfying the inequality 

\Xn — L\ < €. 

The distinction between the definition of the limiting point 
and that of the limit is that, in the definition just given, the 
inequality 


•See Chap. VIII. 


\Xn - L\<€ 
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must be satisfied for any infinite number of terms of the sequence, 
whereas in the definition of the limit the same inequality must be 
fulfilled for every Xn whose index n exceeds some fixed positive 
irdeger p. Any number that occurs an infinite number of times 
in a sequence is obviously a limiting point. Thus, the sequence 

(7-2) 1, 1, Vs, 1, H, 

has 1 and 0 as its limiting points, but the limit of this sequence 
obviously does not exist, 

A fundamental theorem concerning bounded sequences, due 
to B. Bolzano and K. Weierstrass, is stated as follows: 

Every bounded sequence possesses at least one limiting point. 
Moreover, it can be established that every bounded sequence 
has a least limiting point and a greatest limiting point. * This 
latter assertion is certainly obvious if the number of limiting 
points of the sequence is finite. 

Definitions of Upper and Lower Limits. The least limiting 
point of a bounded sequence {a^n} is called the lower limit and is 
denoted by the symbol 

lim Xn == L 

The greatest limiting poird of a hounded sequence [xn is called 
the upper limit and is designated by the symbol 

im Xn = L. 

Recalling the definition of the limiting point, it is clear that 
if H is the lower limit of the sequence then for any € > 0, 
there will be infinitely many terms of the sequence such that 

Xn < i 

and at most a finite number of the Xn's such that 

Xn < i 

On the other hand, L is the upper limit of the sequence {xn} 
if there are infinitely many terms of the sequence such that 

Xn > 2/ — 

For a rigorous arithmetical proof of these assertions see E. W. Hobson, 
Theoiy of Functions of a Beal Variable, Secs. 46-48. 
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and only a finite number (or none at all) such that 

Xn > 1/ + c. 


It follows from these statements that —1 is the lower limi t of 
the sequence (7-1), while +1 is its upper limit. The lower 
and upper limits of the sequence (7-2) are 0 and 1, respectively. 

It is customary to extend the definitions of the upper and 
lower limits to unbounded sequences by saying that if there are 
infinitely many terms of the sequence {a:*} whose magnitude 
exceeds any preassigned positive number M, then the upper limit 
L is + 00 ; on the other hand, if the sequence {a;»} is such that 
there are infinitely many terms satisfying the inequality, 

where M is any arbitrarily large positive number, then the lower 
limit Z is — 00 . 

For example, the sequence 

(a) 1, 2, 3, • • • 

has L = + , whereas the sequence 


(6) -1, -2, -3, • • • 

has Z = — 00 . The sequence 

(c) -1,2, -3,4, -5,6, • • • 


has L = + <» and Z = — oo. 

Some further examples of upper and lower limits of sequence 
may prove useful. The sequence 


(d) 


1 1 11 
^’2’ “3’r 


(- 1 )’ 


has L 0 and Z = 0, but the sequence 


+ 1 , - 1 , + 1 , - 1 , + 1 , • • • 

has Z = — 1 and L = 1. The sequence 

2, K, 4, • • • , • • • 

has Z — 0, L = 00 , whereas 

-1, -2, -H, -4, • • • , 

has Z = — CO and 2/ = 0. 
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It will be observed that no definition of the lower limit was 
supplied for sequences of the type (a), whereas sequences of the 
type (6) lack a definition of the upper limit. It is desirable to 
fill these gaps so that one can say that every sequence has 
uniquely defined upper and lower limits. Accordingly, it is 
agreed that if the sequence is such that +oo is its only 
limiting point, then the lower limit I of such a sequence is also 
+ . On the other hand, if — is the only limiting point of 
the sequence, then both the upper and lower limits are defined 
to be — 00 . 

The sequence (d) is interesting because it has L « i! » 0. 
There is a theorem in regard to bounded sequences whose upper 
and lower limits are equal. 

Theorem. A necessary and sufficient condition for the conver¬ 
gence of a hounded sequence is that the upper limit L be equal to the 
lower limit L 

The proof of the theorem is not diflhcult. For, if 
jL - Z - A, 

then for any € > 0 there is at most a finite number of terms 
of {xn} such that 

'!> L "jr € ^ €f 


and also at most a finite number of Xn for which 
Xn < I — e ^ A — 


Thus, 


A Xn A Hf" 


if n ^ p^ 


or 

\xn — A| < €, if n ^ Pf 
which is the statement that lim Xn ^ A, 

n.—► 

Conversely, if 


lim Xn = A, 

n-4 « 


then for any « > 0 and forn ^ p 
(7-3) I®, -A\<€ 
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or 

A — e<a:»<A+«. 

Therefore, 

(7-4) Xn A e 

for an infinite number of x„, and the inequality 

x„ < A — e 

is true for at most a finite number of the a:„. Thus 
(7-5) Z = A. 

But (7-3) also states that 

Xn > A — t 

is true for an infinite number of Xn, and that there are at most a 
finite number of Xn for which 

x„ > A -I- e. 

(Consequently, 

(7-6) L = A. 

It follows from (7-5) and (7-6) that 

I = L. 


PROBLEMS 


1. Which of the following sequences diverge? 


(o) 0, 1, 0, 2, 0, 3, 0, 4, ■ • ■ ; 

(6) 1, K, ; 

(c) 1, -M, 

(d) - ; 


3 7 2-+1 - 1 . 

2’ 2 >' ’ 2 ' 




(f) log 1, log 2, • • ■ , log n, • • • ; 

log 2 ’ log 3^ ’ log n ’ 

(h) log i, log , log • 


2. Find the upper and lower limits for the sequences of Prob. 1. 
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8. Functions of a Single Variable. Let a pair of variables y 
and X be connected by some functional relation. The functional 
dependence of y upon x will be denoted by the symbol y — f(x), 
which means that to every value of x under consideration there 
corresponds at least one value of y. There is no implication in 
the foregoing statement that there is an analytical expression or a 
formula connecting y with x. In the study of elementary 
analysis one usually thinks of a function as being given by a 
formula indicating the result of performing some operations on x, 
such as x^, VI — log X, sin 2x, etc. In the definition given 
here the term function has a much broader meaning. 

It will be assumed that the variable a; is a real variable and that 
the corresponding values of y are also real. The function 
y = f(x) is called a single-vcdued function if to every value of x 
under consideration there corresponds one and only one value of 
y. Otherwise, the function f{x) is called multiple valued. Thus 
y = a:* is a single-valued function, whereas y »= sin“^ a: is a 
multiple-valued function of x. 

It is frequently necessary to restrict the range of values which 
x is permitted to assume. The function y =» V® furnishes 
real values for y only if a; is restricted to be positive or zero. 
It is convenient to think of the values of a: as being associated 
with the points of the a:-axis of a cartesian system of coordinates, 
so that one can speak of the interval consisting of all real numbers 
between a pair of given values (say, a: = o and x = b). Such an 
interval is denoted by the symbol (a, b), where a <b. If the end 
points of the interval (a, b) are excluded from consideration, the 
interval is said to be open, and the fact that x is not permitted to 
assume the values a and b is denoted by writing 

a < X <b. 

On the other hand, if the interval is closed, one writes 

a^x:^b. 

The interval may be open at one end point and closed at the other. 
For example, 

a ^ X <b 

means that the interval is closed on the left, so that the point 
X « a is ihcluded in the considerations, whereas a; »> bisexduded. 
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If for aU values of a: in a given interval, f(x) is never greater 
than some fixed number M, the number M is called an upper 
bound for f{x) in that interval, whereas if f(x) is never less than 
some number m, the latter is called a lower bound. One or both 
of these bounds may not exist. Thus y = sin a: in (0, 2x) has 

an upper bound +1 and a lower bound —1, whereas y = - in 

the interval (0, 1) has a lower bound unity and no upper bound. 

The function y = ^ x has neither upper nor lower bound in the 

interval (0, oo). 

In considering the functional dependence of y upon x, it may 
happen that as x approaches, by any conceivable sequence of 
steps, the limit a;o, y also approaches a limit L, so that one can 
write 

(8-1) lim y = lim f{x) 

x-^xo x-^zo 

The precise meaning of this symbolic expression (8-1) is embodied 
in the following definition of the limit of f(x ): 

The function f{x) approaches the limit L as x tends to Xq when, 
corresponding to any given positive number €, one can find a number 
8 such that \f(x) — L\ < e for all values of xfor which 

0 < \x — Xo\ < 8. 

It should be noted carefully that the statement 

0 < lx — Xol < 5 

excludes the point x == xo from consideration, so that the numer¬ 
ical value of the difference must be less than e for aU points in 
the interval (xo — 5, xo + 5), except at the point x = xo. More¬ 
over, no restriction is imposed as to the way in which x is per¬ 
mitted to approach xo, so that the inequality 

|/(x) - LI < € 

must be satisfied whenever x xo through a set of values greater 
than or less than xo. 

It may be remarked that, since 

(8-1) lim f(x) = L 

x—*xo 
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means \}{x) — L\ <e for all values of z for which 

0 < [re — a:o| < S, 

one can write (8-1) in an alternative form 

(8-2) fix) = L -f ij, 

where Iij| < « for all values of x such that 0 < |a: — xo| < 
The particular form (8-2) of the definition (8-1) will be of fre¬ 
quent use in the following pages. 

It is sometimes important to know the behavior of f{x) when 
X —> xo in such a way that x always remains greater (or less) than 
Xo, that is, when x is allowed to approach xo from the right (or left) 
side only. In such cases it is convenient to adopt the following 
notation. If x —»Xo from the left (that is, x is always less than 
Xo), one writes 


X —»Xo—, 

and the fact that x-^xo from the right (so that x is always 
greater than Xo) is denoted by 


X—»Xo-f-- 

These limits will be called the left-hand and the right-hand 


limiU, respectively. 

Also 


II 

or /(xo—) “ a, 

and 


lim/(a;) « h 

or /(xo-f) <* b, 


wiE stand for the left-hand and right-hand Emits of fix). The 
symbols /(xo-f-) and /(xo— ) should not be confused with the 
symbol /(xo), which means the value of the function/(x) calcu¬ 
lated at the point x = Xo. In fact /(xo4-) and /(xo— ) may exist, 
whereas the function fix) may not be defined at x «» Xo. To 

clarify this, cotnsider an example. Let fix) <■ ——j. It 


1 — « 
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is readily established that 

lim/(a;) =/(0-) = 0, 

x —*0 — 

and 

Iiin/(x) =/(0+) = 1, 

z^XQ-\r 

while 


m = 

1 - eo 

which is utterly devoid of sense 
since division by zero is undefined 
(Fig. 5). 


Since another example may prove useful, let f{x) = 

In this case (see Fig. 6)/(I+) = <»,/(l—) = 0, but/(l) = 2^ is 
meaningless. 



The function |/ = sin i has neither /(0+) nor /(O—), since 

(JO 

sin - oscillates between its upper and lower bounds +1 and — 1 

X 

as X 0 from either side (Fig. 6). 


PROBLEMS 

1. Find the right-hand and left-hand limits of f(x) = x* as x 2. 
What is lim x^? 

2. Find/(04-) and/(0—) if/(x) = ^ ^ gi/i ' What is lim/(a:)? 

3. What axe /(0+) and /(O—) if f(x) = x sin -? Sketch the graph of 

X 

fix) in the vicinity of x = 0. Find lim fix), 

*—+o 
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4. Eind/(2+) and/(2—), if/(a;) -- - 

X — / 

6. What is lim sin x? sin 


}» 


6. Find lim — --rr' 
x-*o 1 - 

Sketch the graph of the function in the neighborhood of a: »« 0. 

9. Theorems on Limits. 

Theorem 1. The limit of a mm is equal to the sum of the limits. 
If lim/i(a:) = Li and lim/sCa:) = Ls, then 

X~^X0 

lim [fi(x) + Mx)] = Li + Lt. 

«—►JCO 

The proof of this theorem follows directly from the definition 
of the limit. It is required to show that for any preassigned 
positive number < one can determine a number 3 such that 

\Mx) + Mx) - Li - L%\ < t, 

whenever x lies in the interval 0 < |x — xoj < 5. But, by 
hypothesis, lim fi{x) = Li, so that 

(9-1) l/i(*) — Li\ < whenever 0 < |x — xo| < 

Similarly, 

(9-2) \Mx) — Lt\ < whenever 0 < |x — Xo( < ds. 

Now if 8 is chosen to be the smaller of 3i and 3s, then it follows 
from (9-1) and (9-2) that* 

|/i(x) + /s(x) — Li — Lt\ < I “h I 
whenever 0 < |x — Xo| < 8. 

* Since the sum of the absolute values is not leas than the absolute valus 
of the sum. 
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But this is precisely the statement that 

lim +Mx)] = Li + Li. 

X —►ajo 

The extension to a greater number of functions follows immedi¬ 
ately. 

Theorem 2. The limit of a product is equal to the product of the 
limits. 

If lim fi{x) = Lx and lim f%{x) = L 2 , then 

x—^xa 

(9-3) ]im/i(x)/2(a:) = iiLj. 

Xr-^XQ 

It is required to show that 

\h{x)hix) — LiLi\ < e, whenever 0 < [a; — a;ol < 5- 
But 

\h(.x)fiix) - LiLi\ = \h(x)fi{x) - L^iix) + L4i(x) - LM 
^ \SMfi{x) - L4i(?:)\ -1- \Lifi{x) - LM 

= I/*(®)1 - l/iC*) - H + M ■ l/sC*) - Li\. 

By hypothesis lim fi{x) = L 2 , so that f^ix) is surely bounded 

«—♦•aso 

in the neighborhood of the point x = xo. Hence, \fi(x)\ < M 
for aU values of x such that 0 < |x — xo| < S'. Then 

\fi(.x)Mx) - LM\ < M ■ |/i(x) - Li| -1- M • |/ 2 (x) - Li\. 

Moreover, since ]im/i(x) = Li and lim/ 2 (x) = Li, corresponding 

«-+aJo *—♦«> 

to any € > 0, one can find a positive number 5 < 5' such that 
|/i(x) - Lil < 

and 

I/ 2 (x) - Li\ < 

whenever 0 < jx — xol < S. Thus 

~ LM\ < M. • + li'il ’ 2|^ “ *> 

whenever 0 < jx — Xo| < 5, which is equivalent to (9-3). 
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The result can be immediately generalized to any number 
of functions. 

Theorem 3. The limit of a qmtient is equal to the quoUent of the 
limits, provided the limit of the denominator is not zero. 

If lim fx(x) = Lx and Urn Hx) = L, 5 ^ 0, then it must be 

proved that 

Note that 

fxjx) , /i(a:) 

Li ft{x) _ 

But, since the limits of fxix) and ftix) exist and lim Mx) ^ 0, 

one can certainly make the numerical value of each bracketed 
term of the right-hand member of the last expression less than 

1, when 0 < la: - a:ol < S. Therefore, 

2 

e. when 0 < ja; — iCol < 

f2W L 2 

which is the required result. 

PROBLEMS 

1. Give a careful justification of the inequality 

!/’<*>-^-1^ «< I*-“!<'■ 

used in the proof of Theorem 3. 

2. If n is a positive integer, prove that lim * 0, and, hence, that 

lim (oo + Uii® + uaaj* + + 

as—fO 

10# The Base of the Natural logarithiES. An interesting 
application of the criterion for convergence of monotone 
sequences to the determination of the hmiting value of the 

function f 1 + aa a: —>■«», is contained in this section. 


fx(.x) _ Lx r /i(^) _ |ul ^ 

Li I Li lij 

“ Lx] 
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It will be shown first that 



approaches a limit when 


X tends to infinity by assuming positive integral values. In 
this case the problem reduces to the study of the behavior of 
the sequence {xn}, the nth term of which is given by the formula 



It will be shown that the sequence {a^n} is monotone increasing, 
bounded, and hence convergent. 

Now the ratio of to Xn^i is 



But by the inequality of Bernoulli,* for any n > 1, 




> 1 -” 

n 


Hence, 


^n—1 


> 1 , 


SO that the sequence {xn} is monotone increasing. Moreover 
it is bounded on the right, since 




/ ^\n+l 

and the sequence (1 + ^) monotone decreasing, t 

* See Sec. 4. 
t See Prob. 2, p. 31. 
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Therefore, 


and thus 


(■*;)■ 


converges to some limit, which will be denoted 


by the letter e. Hence, 

(10-1) lim (l ■+• 

n —► « \ fi'/ 


e. 


Consider now the function 




where x is allowed to take on any sequence of positive real 
values tending to infinity. Let n be the greatest integer con¬ 
tained in any given value of x, so that 

n ^ X < n + 1, 

If X tends to infinity, the number n does likewise, and one can 
write 


But it follows from (10-1) and from Sec. 9 that 

n—► w \ n- “T* 1/ -j- ^ 

1 


e. 


Also 


iim(i+‘)""‘.ii»r(i+‘y(n-iy 

n/ n-»L\ n/\ nj 

Since the extreme members of the inequality (10-2) tend to 
the same limit, it follows that 


( 10 - 3 ) 




e. 
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The problem of computing a rational approximation to the 
number e with any desired degree of accuracy is discussed in 
Chap. IX. 

PROBLEMS 

1. Show, with the aid of the result (10-3), that 



Hint: Introduce the new variable ^ s — (1 -f a;) and let $ tend to infinity 
through any set of positive values. 

2. Show that the sequence { 2 /n}, the nth term of which is 



is monotone decreasing and bounded. Form the sequence {y» — 
where {xn} is the sequence discussed in Sec. 10, and hence, deduce that 
lim Vn - e. Show that 1 e < 3. 

ti—► 00 

11. Continuity. In defining the limit of f(x) as x--^xqj no 
assumption was made regarding the value of the function at 
X = Xo- In fact, it was emphasized that the function need not 
be defined at x = Xq. 

The function f{x) is said to be continuous at the point x = Xq, 
if the right-hand and left-hand limits of f{x) as x-^xo are equal 
and finite and coincide with the value of the function at x = xo. 

This definition can be stated compactly in the form of an 
equation 

(11-1) limf{x) = f{xo). 

A more explicit way of restating the definition of continxiity 
(11-1) is the following: 

If for any preassigned positive number €, one can find a positive 
number d such that 

(11-2) \f(x) —/(xo)! < €, whenever \x — XqI < d, 

then the function f(x) is continuous at the poird x = Xq. 

A geometrical interpretation of the statement embodied in 
(11-2) is immediate. Corresponding to any preassigned positive 
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number e, there can. be determined an interval of width 25 about the 
point X = xa (Fig. 7) such that, for every x lying in the interval 
(aio — 6, xo + 5), Six) is confined to lie between /(a:o) + e and 
/(cco) - e. 

An alternative way of writing the defining equation (11-1) 
is frequently useful. Thus (11-1) can be written in the form 

(11-3) /(*) = fixS) ■+- V, 

where lim ij = 0. The identity of (11-1) and (11-3) follows 

a;—tico 

immediately upon taking the limit of both members of (11-3). 





Two important remarks are in order: 

a. If the function is continuous, then lim f(x) must exist, 

h. The function must be defined at the point of continuity. 

The significanoe of these remarks is made clear by the following 
examples: 

lUusirative Example 1. To test the continuity of /(*) ■» at 

X = 2, note that /(2) =■ 4. Moreover, Urn ** -« 4. Hence, 

it-*a 

Six) = x^ is continuous at x »* 2. 

X* — 0 

lUuMraiive Example 2. Let /(x) »■ ^ Now 



-4*3 IMM. O 

which is meaningless. But lim -- - Hm (x + 3) 6. 

Hence, if /(x) is defined to be equal to 6 at x 3, then /(x) will 
be continuous at x - 3, but not otherwise. 
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Illustrative Example 3. Let fix) = * if x 9 ^ d, and let 

fix) = 1 if x = 0. Now lim 1, which coincides with the 

X —►O ^ 

definition of fix) at x 0, so that fix) is continuous at a; = 0. 

If it happens that the function fix) is continuous at every 
point of the interval (a, 6), then the function is said to be con¬ 
tinuous over the interval (a, 6). If the interval is closed, the 
continuity at the end points x = a and x = b is defined by the 
equations 

lim fix) = /(a) and lim fix) = fib), 

x—*h — 

since such a symbol as 

lim/(a;) 


has no meaning if the consideration of functional values is 
restricted to the closed interval (a, &). 

It is clear from the foregoing that any function that can be 
represented graphically as an unbroken curve is continuous. 
However, not evety continuous function can be represented 
graphically. For example, let 

fix) X sin -y 

X 


and consider the behavior of the function in the vicinity of x = 0. 
Inasmuch as sin ~ is defined at every point of the x-axis, except 

X 

X = 0, dne can calculate the values of f{x) for any sequence of 
values of x converging to zero. Moreover, since sin - is bounded, 

X 


lim X sin ~ = 0. 

At the point a; = 0, f(x) is undefined, but if it is agreed to assign 
the value zero to /(O), the function 

fix) = a: sin -j if x 9 ^ 0, 

X 

s* 0, if X = 0, 
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will be continuous at a; = 0; yet the graph of the function in 
the vicinity of the origin cannot be drawn, since the function 
oscillates infinitely often in any interval containing the ori^n 
(Fig. 8). 

Whenever a function fails to be continuous at a point, it is 
called discontinuous at that point. The discontinuity at a; = xo 
is called infinite whenever /(x) becomes infinite as x —> Xo. If 
the function is discontinuous at a point x = Xo but is bounded 



in the vicinity of that point, the discontinuity is called finite 
or ordinary. If/(xo+) and/(xo—) exist and are unequal, their 
difference 


,, /(®0+) —/(Xo —) 

is called the jump in the function. Thus the function 

fix) -L_^ 

1 — e~» 

discussed m Sec. 8 has a jump of one unit at x « 0, whereas 

/(*) ~ has an infinite discontinuity at x =* 1. 

A function haying a finite number of jumps in a given interval 
18 called piece-wis$ continuous or sectionally continuous* \ 
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PROBLEM 


Discuss the continuity of the following functions: 


(а) y = x® — 2x; 

(б) y = 2»; 

(c) y = e*; 

(d) y = log x; 

(e) y = a: sin 

X 

(S) y = sin^; 


(y) y = 

W y = 


(1 - 
1 

1 - a:®' 


(*) y = 


1 

a:® - 3a; + 2’ 


O') y = a; + ^; 

(A;) y cot x] 

1 ““ cos X .. 

(0 y > if a: 0, 

= 0, if a; = 0; 

(m) y = ^if a; 3^ 1, 

= 2, if a; == 1; 

-.JL 

{n)y = e ^\\lx 0, 

= 0,ifa;==0; 

(o) 2 / = 1 — a;, if a; > 0, 

= 1 + a;, if a; < 0, 

== 1, if a; = 0. 


12. Properties of Continuous Functions. It was seen from the 
discussion of f{x) x sin ~ in Sec. 11 that the intuitive idea of a 

X 

continuous function as a function that can be represented 
graphically as an unbroken curve is quite inadequate to account 
for functions that are continuous according to the definition 
given above and that may not be capable of graphical representa¬ 
tion in the neighborhood of a point of continuity. A function 
that can be represented graphically as an unbroken curve is, of 
course, continuous. 

The seemingly simple concept of continuity becomes, on careful 
examination, exceedingly complex. A detailed study of the 
properties of continuous functions is the province of the theory 
of functions of a real variable, but some of the simpler theorems 
follow directly from the definition of a continuous function and 
upon the application of the theorems on limits. 

Theorem 1. The sum, difference, product, and quotient of any 
finite number of functions, each of which is continuous at a given 
point X = Xo, will be continuous at ‘x = Xo, provided that the denom- 
inator of the quotient does not vanish atx=^xo. 

The proof of this theorem follows immediately from the 
definition of continuity with the aid of the theorems of Sec. 9. 
It is left as an exercise for the reader. 
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Theorem 2. If y — Mx) is a continuous function at the point 
X = xo, and if z - faiy) is a continuous function cd y = Vo, where 
Vo = fiis^o), then the composite function z — ft[fi(^)] continuous 
at X = xo- 

By hypothesis z = fify) is continuous at y = yoj so that 
lim/aCy) =/s(yo). 

Hence, corresponding to any « > 0, one can find a positive 
number 5i such that 

\Hy) - h{y^)\ < \y 

But 

hiy) 

and, therefore, the foregoing inequality can be written as 
(12-1) |/ 2 [/i(x)] - / 2 (yo)l < «, when |/i(x) - yo| < h. 

But fiix) is also continuous at x = Xo; hence, corresponding to 
the positive number Si, one can find a positive number S such 
that 

IfiQs) — yo| < 5i, whenever jx — Xol < 5. 

Thus (12-1) can be rewritten to read 

l/s|/i(a5)] -/ 2 (yo)| < «, whenever |x - xo| < S, 
which is another way of saying that 

lim/ 2 L/‘i(x)] =Myo). 

»—>a5o 

The latter stat^ent is precisely the definition of continuity. 

Theorem 3. If f{x) is continuous atx = Xo andf(xo) 0, tAen 
one can find an interval about the point x = Xo such that /(x) has 
the same sign as /(xo) throughout this interval. 

The continuity of /(x) at x = xo means that corresponding to 
any « > 0 one can find a number S such that 

(12-2) |/(x) — /(xo)| < «, when jx ~ Xol < 5. 

Now (12-2) can be written as 

(12-3) /(xo) — € < /(x) < /(xo) -f e, when |x — Xo| < S, 
and if « is chosen to be equal to |/(xo)l, the inequality (12-3) 
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reads 

{12A) f(xo) - \f{^o)\ < fix) < fix,) + \fixo)l 

when [a; — xol < 5o. 

Hence, if fix,) > 0, (12-4) becomes 

0<fix)<2fixo), 

so that fix) is positive for all values of x in the interval 
Xq — 5o aj a?o 4“ 5o. 

On the other hand, if fix,) < 0, then the inequality (12-4) shows 
that fix) < 0 in the interval xo — 5o < x < Xo + 5o. 

The reader might be inclined to regard the theorems just 
established as obvious from graphical considerations, which 
they indeed are if one restricts oneself to those continuous func¬ 
tions which can be represented by unbroken curves. 

13. Uniform Continuity. In defining the continuity of a 
function at a point x = Xo, it was stated that, corresponding to 
an arbitrary positive number c, one can find a positive number d 
(depending on c) such that for all values of x in the interval of 
width 2d, with Xo as the midpoint of the interval, the numerical 
value of the difference fix) — fix,) will be less than €. 

It is important to observe that the magnitude of 8 depends on 
both the number € and the value of x under consideration. This 
can be made clear by considering the function/(x) whose graph is 
shown in Fig. 9. Let e be prescribed; then for all values of x 
in the interval of width 25i about x = xi 

l/Caj) -/(a:i)l < €, 

whereas in order to make ^ 

l/(x) < € 

one would require the values of x in the neighborhood of the 
point X = X 2 to lie m a much smaller interval of width 252. 
Now the remarkable fact about functions continuous in a closed 
interval (a, b) is that one can find a number 5 which is independent 
of the particular value of x under consideration and thus depends 
on € alone.* Or, to put it differently, if the interval (a, b) is 

♦ The proof of this is omitted. See E. W. Hobson, Theory of Fxinctions 
of a Beal Variable, p. 290; E. Goursat, Cours d'analyse math^matique, 
6th ed., vol. 1, p. 14; C. J. de la VaUee Poussin, Cours d'analyse infinitesi- 
male, vol. 1, p. 68. 
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divided in any manner whatever into a finite number of sub- 
intervals of widths not exceeding 25, then for any two points 
in the same subinterval, the numerical value of the difference 
between the values of f(x) will be less than 26. To signify the 
fact that a single number 5 will serve for dll values of x in the 
interval (a, 6), one says that the function is uniformly continuous 
in the interval. 

It is not difficult to see that a function which is continuous 
in the open interval (a, h) need not be uniformly continuous. 



Thus, the function fix) = - is continuous in the open interval 
(0, 1), but it is'inot uniformly continuous there. The difficulty 
here arises because - becomes infinite as a; 0. For any nonzero 

X 

value of X the function is continuous, but it is impossible to 
subdivide the interval (0, 1) into a finite number of subintervals 
such that the numerical value of the difference of the functional 
values, for any pair of points in each of the partial intervals, is 
less than a preassigned number «. 

The property of uniform continuity of functions defined over a 
closed interval is used in the following theorems. * 

* The proofs of Theorems 1 and 2 •will be found in E. W. Hobson, Theory 
of Functions of a Beal Variable, pp. 281-286; E. Qoursat, Cours d’analyse 











§13 LIMITS AND CONTINUITY 39 

Theorem 1. A function f(x) continuous in a closed interval 
(a, b) is bounded in that interval. 

The theorem states that one can find a positive number M 
such that l/(a;)l ^ M, for all values of a; in the interval a x Sb. 

Theorem 2. If f(x) is continicous in a closed interval (u, 6), then 
there exists in this interval at least one value of xfor which f(x) takes 
its maximum value and at least one value of x for which it assumes 
its minimum value. 

Theorem 3. If f{x) is continuous in a closed interval {a, b) then, 
as X takes all values between a and b, the function f(x) takes at 
least once all values intermediate to f (a) andf(b). 

CoroUary* If f{o) andf(b) are of opposite signs then there exists 
at least one point intermediate to a and b such that fix) vanishes at 
that point. 

In order to give an idea of the type of reasoning employed 
in proving these theorems, the proof of Theorem 3 follows. The 
corollary to Theorem 3 will be established first. 

Let the signs off (a) and/(&) be opposite and set K(a + 6 ) = xi. 
If f{xi) vanishes, the corollary is demonstrated. If f{xi) 5 ^ 0 , let 
(ai, 61 ) be that one of the two equal intervals (a, Xi) and (a^i, b) 
for which /(ai) and /( 61 ) are of opposite signs. Form 

X 2 = M(^i H“ ^^i)- 

/(^ 2 ) = 0 , the corollary is established. If f(x 2 ) 9 ^ 0 , let 
(^ 2 , & 2 ) be that one of the two equal intervals (ai, X 2 ) and {x 2 , bi) 
for which f{a 2 ) and fQ) 2 ) are of opposite signs. If in continuing 
this process one does not obtain a number Xi such that /(x<) = 0 , 
there results a sequence of intervals 

(a, b), (ai, bi), (at, bt), (a„, 6„), 

such that each of them is contained in the preceding, and such 
that the function fix) has opposite signs at the end points of 
these intervals. 

The numbers a, ai, Ua, • • • , On, • • • form a monotone- 
increasing sequence and remain less than b, so that they tend to 
some limit* c contained between a and b. The numbers 6 , bi, 
62 , • • • , , on the other hand, are always greater than a 

math^matique, 6th ed., vol. 1, p. 16 (the English translation of this book 
contains these proofs on p. 143). 

* See Sec. C 
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and form a decreasing sequence, so that they also converge to 
some limit c'. The limits c and c' are equal since the difference 

K- On- ^(i> - a) 

tends to zero when n increases indefinitely. 

But/(a;) is continuous in the interval (a, h), and therefore the 
difference 

/(bn) -/(a,) 

approaches zero when n —> *>. Moreover, since the signs of 
/(6„) and /(a„) are opposite, 

lim |/(bn) — /(<in)| = 2|/(c)| = 0, 
n-^ 00 


or 

/(c) = 0. 

Thus the corollary to Theorem 3 is demonstrated. 

In order to estabhsh the theorem itself, let k be some number 
between /(a) and f(h) and form the function 

Fix) =fix)-k. 

The function Fix) is continuous in the interval (a, b) and has 
opposite signs at the end points of the interval so that there 
exists at least one value c intermediate to a and b such that 
Fic) = 0. But, if Fic) = 0, 

/(c) = k, 

and the theorem is demonstrated. 

It may be remarked that if fix) is steadily increasing or decreas¬ 
ing and is continuous in the closed interval (o, b), then there will 
be exactly one value of x, intermediate to a and b, for which/(a:) 
assumes a prescribed value k, intermediate to /(o) and fib). 



CHAPTER II 

DERIVATIVES AND DIFFERENTIALS 
14. Derivatives.* 

Definition. If x = Xa is any point of the interval (a, b) and if 
f{x) is a function of x defined over (a, b), then 

1. /(go + h)- f(xo) 

)k-*o h 

is called the derivative of f(x) at the point x = Xo. 

Denoting the derivative of f{x) x = xo by the symbol/'(go) 
and recalling the definition of the limitf give 

( 14 . 1 ) /fa+J) 

where 


lim 1 ? 0. 

h-*0 


Rewriting (14-1) gives 

/(xo + h) - /(xo) = hf'{xo) -h hr, 

hence, ' 

|/(xo + h) -/(xo)l ^ lA/'(go)l + \hri\. 

Now if any € > 0 is prescribed, 

|A/'(xo)l -b M 

can be made less than t by making h suj£ciently small. Then, 
for any value of x in the interval Xo — A < x < xo + h, 

l/(g) - /(go)l < e, 

* The reader is assumed to be familiar with calculations involving the use 
of the formulas for the differentiation of the so-called ekmentary functions. 
It is advisable to review them before proceeding with the study of this 
chapter, 
t See p. 24. 
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which states that f{x) is necessarily continuous at a; = xo if it 
possesses the derivative at x = xo. This result can be stated as a 
theorem: 

Theorem. Any function having the derivative at a point ie 
necessarily continuous at that point. 

The converse of the theorem is not true, as can be seen from 
the following example (Fig. 10): let 

/(x) = —X + 1, when x > 0, 

/(x) = X + 1, when x 0. 

The function is obviously continuous at x = 0, but the derivative 
at X = 0 does not exist since the limit of the difference quotient 

f(x + h) - fix) 
h 

independent of the mode of approach of h to zero, does not exist. 
This becomes clear immediately if one recalls the geometrical 



1/ “ —a; -f-1, if as > 0; 

*■35 + 1, if X S 0* 

interpretation of the derivative as the slope of the tangent line 
to the locus of /(x). If the point x = 0 is approached from the 
right, the slope of the tangent line is —1, whereas it is equed to 
+1 when X -> 0 from the left. 

•As a more interesting example consider the function 

f(x) = X sin if X 0, 

= 0, if X = 0, 

which was shown* to be continuous at x 0. However, the 
difference quotient is 
* See p. 33. 
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/(0 + A) -/(O) 

- - ---sm^, 

and lim sin i does not exist, since sin oscillates between +1 and 
h-^o ^ n 

— 1 as A 0. 

To be sure, this function has a derivative at every point except 
X = 0, but it is possible to construct functions that are continuous 
for all values of a; in a given interval, but that do not have a 
derivative at a single point of the interval.* Functions that have 
derivatives are called differentiable functions. 


PROBLEMS 

1. Show from the definition that/'(I) ~ if/(a;) = y/x, 

2. Does the derivative of 


exist at x 

3. Let 


Then 


1 ? 


fix) = 


a; - 1 
1 + 


= 0 , 


if X ly 

if a; = 1, 


/(a?) 


x^ sin —; 

X 


= 0 , 


if 

if 


X 0, 

a; = 0. 


/'(O) 


= lim 
/i-^o 


/(0 + A) -m 

h 


lim 

A-vO 


sin 1/A 
h 


= 0 . 


For any point other than a; = 0 a formula for the differentiation of the 
product can be used Thus, 


fix) = 2 X sin i — cos i; 

X X 


which is meaningless at x = 0. Why? 

16. Differentials. If the functional relation between y and x 
is given in the form 

y = f(x), 

* K. Weierstrass was the first to demonstrate the existence of such func¬ 
tions in 1861, Many examples of such functions have been constructed 
since then. 
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the variables y and x are called, respectively, dependent and inde¬ 
pendent variables. 

Let Ax be an arbitrary increment in x. The resulting change 
in the dependent variable y when x changes by an amount Ax 
will be written as ty. The increment of the independent variable 
X win be named the differential of x and denoted by either Ax or 
dx. The differential of the dependent variable y, on the other 
hand, is defined by the formula 

(16-1) dy = /'(x) dx, 


so that the differential dy and the increment Ay of the dependent 
variable, in general, are quite distinct. From the defining equa¬ 
tion (16-1) of the differential, it is clear that the derivative of 
y = f(x) can be expressed as the quotient of two differentials, 
namely. 



In this expression dx is assigned at pleasure, but dy is determined 
from (16-1). 

From the definition of the derivative 


it is seen that 


where 


fix) ^ lim g, 


Ax 


■■ f'i^) + n, 


lim i; = 0. 

Aaf-~K) 

Solving for Ay gives 

by - f'(x) Ax+ 11 

and, since Ax = dx, 

Ay — dy = v Ax. 


For small values of Ax this difference is small. Geometrically 
y Ax represents the portion of the increment Ay cut off by the 
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tangent line to the locus of f(x) at the point where the derivative 
is computed (see Fig. 11). 

Example, Let y == Then dy = 2x dx, while 

Ay — (x + Axy ^ x^ = 2x Ax + {Ax)\ 

In this case Ax = (Ax)^, so that i| = Ax. 

PROBLEMS 

1. Find dy and Ay^ if 2 / = x®. 

2. Find dy and Ay, if 2 / = \/x + 1, x ^ 0. 

3. Find dy and Ay, if 2 / = sin x. 

16. Derivatives of Composite Functions. If 2 = f(y) and 
y = <p{x), one can eliminate y between these relations and obtain 

z = f{<p{x)] = Fix). 

• di& 

The function z = F(x) may have a derivative -t-j but often it is 

ax 

undesirable to perform the elimination of y in order to calculate 





X X-f-JX 




Fia. 11. 

If the functions f{y) and <p{x) are differentiable, it is possible 

dz • 

to calculate ^ without performing the elimination. 

Note that if x is given an increment Ax, then y will acquire ah 
increment Ay, and Ay -^0 when Ax 0, since tp{x) is assumed to 
be a differentiable and, therefore, continuous function. But 
corresponding to an increment Ay there will be an increment Az. 
Thus one can write 
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Az T Az Ay 

lira — = lim — • um -t—j 
Air —AiC Ax-^-O A^/ Aac—+0A2? 


dz dz dy 
dx ” dy dx 


In writing (16-1) it is tacitly assumed that Ay 7 ^ 0. There 
remains to be considered the case when Ay = 0 for some choice 
of the values of Aa: approaching zero. Now 


Az = /(y -H Ay) — /(y), 


and if Ay = 0, then Az = 0, so that 


dz Az 

= lun -T” 

dx Aa;-40 AO? 


= 0 . 


Moreover, if Ai/ = 0 then 


die 


Aa?-40 


= 0 . 


Hence, the formula 
(16-2) 


dz __dz dy 
dx ~~ dy dx 


is true in this case also. 

As an illustration of this case, consider the function 


z ^ 


and 


Then 


1 

w = sin if a; 5^ 0, 

= 0, if ic » 0, 

Az ^ 2uAu + (Au)® 


Au 


(Aa:)* sin 


and, for a; = 0, 
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1 i- 

TT Qnr Zt me 


then An = 0, and hence 



Moreover, 


dz 

dx 


1 . 

lim — 

Aa;—>0^^ 


lim^ 


and the formula (16-2) is valid. 

17. Derivatives and Differentials of Higher Orders. Inas¬ 
much as the derivative of y = f(x) is a function of rc, it may be 
possible to differentiate again to produce a new function, which is 
called the second derivative oi fix). The customary notations for 

d^Tj 

the second derivative are /"(a;) and The third derivative, 
that is, the derivative of the second derivative, is denoted by 
f”'(x) or ^7 and so on. 

The reason for the notation wiU be seen from the definition 

dx^ 

of the differentials of higher order. The differential of y ■ fix), 


dy = fix) dx, 


is a function of x and dx, where dx is entirely arbitrary. Calculat¬ 
ing the differential of fix) and treating dx as a constant give the 
second differential 

d^y = d[fix)] dx = /"(^) idx)^. 

Similarly, 

d^y^nx)idx)\ 

and so forth. 

The formula for the differential of the nth order is 


d^y s= f^'^ix) idx)*, 


( 17 - 1 ) 
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so that one can write /«(») as the quotient of two finite quan¬ 
tities, namely, 




This notation, however, is bad. For consider a composite func¬ 
tion z = f{y) where y = <p{x). From Sec. 16 it follows that 

dz - fijj) dy 

when is a dependent variable. But calculating the differentials 
of higher order by the formula for the differential of the product 
gives 

(17-2) d^z = d[/'(y) dy] - f'(y) d{dy) + dy d[/'(y)] 

= f'{y) d^ +f''(.y) (dy)^, 

which differs from the formula (17-1). 

If y is regarded as an independent variable, then dy must be 
considered as constant so that = 0 and (17-2) agrees with 
(17-1), but the two results are quite distinct if y is not an inde¬ 
pendent variable. This is one of the reasons why the differentials 
of higher orders are seldom used.* 

PROBLEM 

Let y = flit) and x = /ift) be such that the functional dependence of 
y upon X is given in a parametric form. It is known that 


dx 


M. 

m 


Now 


dx’ 


dx V^dxy 

Applying the rule for the differentiation of quotients gives 

, dy • dx — d’x • dy 


(17-3) 


dx* 


(dx)‘ 


On the other hand, using formula (17-1), 


dy ■■ /((<) dt, 
dx • fl(t) dt, 

* See also the problem on p. 48. 


d'y 

<Px 


■ fi’it) (dt)*, 
' ft (0 (dt)*. 
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Substitute these expressions in the right-hand member of (17-3) and 
compare it with the expression for ^ obtained in the usual way. 

18. Fermat’s Theorem. The reader is doubtless familiar with 
some geometrical considerations that lead one to suspect that a 
differentiable function S{x) has a vanishing derivative at the 
points where f{z) attains its maximum or minimum values. In 
fact, these geometrical considerations form a basis for the discus- 



4“-A ^ fyh 


Fio. 12. 


sion of the maxima and minima in the first course in calculus. 
An analytical proof of the theorem due to Fermat gives a rigorous 
justification for such considerations. 

Theorem. If a function f{x) assumes a maximum or a minimum 
value at an interior point { of the interval (a, 6), and if f(x) is dif¬ 
ferentiable at x = thenfiX) = 0. 

Let it be supposed that at the point x = f the function attains 
its maximum value. (The proof for the case of a minimum is 
entirely analogous and is obtained by reversing the signs of 
inequality.) Remembering that x {is an interior point of the 
interval and that/({) is a maximum, one has/(^ + A) — /(f) ^ 0 
for positive or negative A. Form the difference quotient 


( 18 - 1 ) 


f(l±]tLzM. 

A 


Since the numerator of (18-1) is negative or zero, 


(18-2) 

(18-3) 


ULtAL-m ^ 0, for » > 0. 

/«+« -m 


0 for h < 0. 
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Taking the limit of (18-2) as A 0 from the right, there results 

/'(f) 0, 

while the limit of (18-3) as A 0 from the left is 

/'(f) ^ 0. 

But by hypothesis the derivative exists at x = {, so that the left- 
hand and right-hand limits must be equal, which is possible only 
if/'(f) = 0. 

19. Rollers Theorem. 

Theorem. If a function f{x) is continuous in the interval 
a X ^ b and has a derivative at every interior point of (a, 6), and 
if the values of the function are equal at the end points of the interval, 
then there exists at least one point a? = f, (a < ^ < 6), such that 
/'(f)=0. 

Since/(x) is continuous in the closed interval (a, 5), it attains 
its maximum value M and its minimum value m in (a, b) 
(Theorem 2, Sec. 13). If it happens that m ^ M, then it follows 
that 

f{x) = const. = m. 


But the derivative of the constant is zero so that the theorem is 
true in this case. 



Next, assume that m < M. By hypothesis/(o) - /(6) so that 
at least one of the values m or il/ is different from the value of the 
function at the end points. Let it be M. Then the maximum 
value M is attained, not at the end points of (a, h), but at some 
interior point f, and it follows from Fermat’s theorem that 
/'«) = 0 . 

It is important to observe that if the condition of the existence 
of the derivative is not fulfilled at a sinjde interior point of (a, 6), 
the theorem may not be valid. This can be seen from Fig. 13. 
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In neither of the examples in Fig. 13 does the derivative exist at 

X ■= 0 . 

If /(a) = /(5) = 0, Rollers theorem can be stated as follows: 
If a and b are two roots of the equation f(x) = 0, then f(x) = 0 
ha^ at least one root between a and b, 'provided thatf{x) is continuous 
in the interval a x b and has a derivative at every interior point 
of (a, 6). 

20. Mean-value Theorem. 

Theorem. If a function f{x) is continuous in the interval 
a X ^ b and possesses a derivative at every interior point of (a, 6), 
then there exists a point J such that 

( 20 - 1 ) 

If /(a) = /(6), the theorem is a special case of Rollers theorem. 
Assume /(a) jA f(b), and construct a function 

F(x) = kx + f{x) 

where the constant h will be so determined that F{x) satisfies the 
conditions of Rollers theorem, namely, 

m = F(6), 

or 

ha + /(a) = fcb + /(6). 

Solving for h gives 

^ _/( &) - fid) , 

b — a 

With this choice of k, the function F{x) satisfies the conditions of 
Rollers theorem. Hence, there exists a point x = ^ such that 

m = fc+/'«) = 0. 

Then 

/«) 

and ihe theorem is established. 

geometrical interpretation of this theorem is interesting. 
The ej^ression 
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m -m 

b — a 

is equal to the slope of the secant line joining the points A and B 
on the locus of/(x) (Fig. 14). 

The mean-value theorem asserts that there exists a point P 
on the locus of /(x) such that the tangent line at this point is 

parallel to the secant line AB. 

The mean-value theorem 
(20-1) can be written as 

(20-2) /(h)-/(a) = 

nm - a), 

which gives the magnitude of 
the increment f{b) — f{a). 
For this reason the form (20-2) 
of the mean-value theorem is 



*iX 


Fig. 14. 


frequently called the formula of finite increments. 

Noting that ? is an interior point of (a, b) and setting 


I - a 


= 0 , where 0 < < 1, 


one can write 


^ i = a+9(b- a). 

Substituting this expression for { in (20-2) gives 
(20-3) f(b) — /(a) = (6 — a)f'[a + ^(6 — a)]. 

If the length of the interval {a, b) is denoted by h, 
b = a, A" b, 

so that the expression (20-3) can be written in the following useful 
form: 

(20-4) /(a A-h)- /(a) = hf'{a -f Bh), 

where 0 < < 1. 

An important theorem follows immediately from the mean- 
value theorem. 

Theorem. If a function has a derivative that vanishes for all 
values of X in the interval a ^ x £ b, the function is a constant. 
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Moreover, if two functions have derivatives that are equal for aU 
values of x in (a, b), then the functions differ by a constant. 

Let X be any point of the interval (a, b), and assume that 
f'{x) = 0 in (a, b). It follows from (20-2) that 

f{x) -fia) =m(.x-a) = 0. 

Hence, 

m =f(a), 

which is constant. 

If fi(^) and f 2 ix) are two functions with equal derivatives in 
(o, b), then 

= Mx) - fiix) 


has a zero derivative in (a, b). Therefore, 

F(x) = const., 

and 

/i(®) = fi(x) -h const. 

21. Theorem of Cauchy. L’Hospital’s Rule. 

Theorem. If f{x) and <p(x) are continuous in the interval 
a ^ X ^ b and have derivatives at each interior point of (o, b), 
then 


m -f(a) _ m 

<p(]b) - <pia) - /({)’ 


(a < { < 6), 


provided that 

i- f'i^) O’Ud <p'(x) do not vanish simultaneously in (a, b); 
ii. <p(b) 9 ^ <p(a). 

Note that the function 


Fix) ^fix)[<pib) - via)] - vix)Uih) -/(«)] 

satisfies the conditions of RoUe’s theorem, since Fia) - Fib). 
Hence, 

(21-1) rmvQ>) - via)] - v'mQ>) - m] = o, 

where (o < { < 6). 

Since fix) and v'ix) cannot vanish for the same value of x, and 
since viV) ^ <pi<^i it follows that v'ii) cannot vanish. Conse- 
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quently, one can divide (21-1) by ~ <®(o)] to obtain 

the desired formula 


( 21 - 2 ) 


fib) -m 

<pQ>) — via) 


(a < f < b). 


If <p'ix) is assumed to be different from zero at every interior 
point of the interval (a, h), then the conditions (i) and (ii) of the 
theorem are satisfied automatically. The condition (i) is obvi¬ 
ously satisfied since v'i^) ^ the fact that vib) — via) 9^ 0 

follows directly from the mean-value theorem. 

It is interesting to observe that (21-2) contains, as a special 
case, the mean-value theorem, for, setting <pix) = x gives 

fib) -fia) =/({)(& - a). 

It is readily shown that (21-2) can be written in the form 

f(a + h) - fia) _ fia + dh)^ /o ^ ft ^ l) 
via + h) - via) v'ia + ffh) ^ ^ 

An important use of formula (21-2) is in the evaluation of inde¬ 
terminate forms. Thus, if /(a) = via) = 0, and if the theorem 
be applied to the interval (o, x), there results 

From this equation the following rule is obtained: 


(a < ^ < x). 


Rule. Iff (a) 


0, and if the ratio approaches a 


limit as a, then approaches the same limit. This rule for 

evaluating indeterminate forms is due to L'Hospital. By way of 
illustration consider the calculation of 

T 1 — cos X 


Now (1 ^ cos a;)*-o = = 0, and one can apply the rule of 

L^Hospital provided that 


exists. But this again is an indeterminate form since 
(sin x)^o * (2a;)*-o « 0, 
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exists since 


Hence, 


lim 
®—>0 


sin X 
2x 


V cos X 
lim 

x—*0 


1 

2 


lim 

»--»0 


cos X 
x^ 


1 

2 


The rule of L'Hospital can also be applied to indeterminate 
forms of the type —• The proof is direct. Let lim f(x) — oo 

00 x-^a 

and lim (p(x) = and assume that f(x) and <p{x) have non- 

x-*a 

vanishing derivatives in the interval a < x < xo. 

Applying the formula of Cauchy to the interval (x, Xo) gives 


But 


Thus 


(21-3) 


fix) - f(xo) 

<pix) — ipix^ (p'iO 


(x < i < Xo). 


1 /(^o) 

fix) - fjxo) ^ f^ fix) _ 

<pix) — <pixo) <pix) - _ yjxo) 

<pix) 

1 _ 

fix) yjx) f'i^) _ 

<pix) 1 _ fixo) v'i^) 

^ fix) 


Assume that 


lim 


fix) 

Vix 


-L. 


This means that one can choose xt so near a that for all values of 
X between a and Xo 


fix) 

Wi?) 


-L\ 


< €. 
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Having chosen xo to satisfy this inequality, let a: —> o; then the 
first factor in the right-hand member of (21-3) can be made as 
near unity as desired. Hence, the left-hand member of (21-3) can 
be made to differ from L by as little as desired. This is another 
way of saying that 


lim 

Z—>(l 


f(x) 

<pix) 


= L. 


The foregoing proof is easily modified to apply when a = oo. 
Example 1. 

1 

lim xlog X = lim = lim -Ar = 0. 

*-►0+ *-^0-+- £ a5---»-0-h^_£ 

X X® 

Example 2. Evaluate lim ^ ^ 


Applying the rule of L^Hospital gives 


lim • 
®--> 00 


re — sin X 

X 


1 — cos X 
lim-- > 


which does not approach a limit since cos x oscillates as x —> oo. 


But 


since 


V X — sin X 
lim- 

X—* 00 X 



== 1 


ism X 

X 


ri 0, as X' 
\x\ 


Note that this does not constitute a contradiction since the 
theorem asserts that if the quotient of the derivatives approaches a 
Umitf then the quotient of the functions has the same limit 




1. Show that 


PROBLEMS 


; (a) Hm 

% z —► 08 


log X 
x» 


0. if n > 0; 


1(6) lim 




0, if n > 1; 
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(c) lim x”e~^ = 0, if n > 0; 

35—4 00 

(d) lim x® = 1. Hint: Evalu^ate lim log a;*; 

»-^ 0 + 35 —> 0 ” 1 “ 




2. Find 

(o) lim log x; 

35 —+ 00 

(6) lim 

X —► 00 

,. sin X 
(c) lun^—; 

a ;->0 


id) lim 


00 a; — sm a; 


(e) lim 

a ;—+0 


3. Show that 


(;-cot*) 

lat 

(a) lim = ,'^: 

a ;—+0 \ ® / 

[b) lim (tan xY^ 2* = l 

IT 

»-2 
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CHAPTER III 

FUNCTIONS OF SEVERAL VARIABLES 


22. Limits and Continuity. Let u = /(*, y) be a real, single¬ 
valued function of two independent variables x and y. One 
can t.hinlr of the pair of values x = xo and y = yo as representing 
a point in the x^-plane, so that u = /(x, y) at (xo, yo) becomes a 
function of the point. 

The function f(x, y) may be determined for every point of 
the xy-plane, or the totality of admissible points may occupy 
a certain region B in the xj/-plane. Thus, if the attention is 
confined to real values only, the function 

u = 

is defined for those values of x and y for which 

y^ ^ 1 . 

The region B in this case is a circle of radius unity whose center 
is at the origin of the xy-plane. If the totality of points making 
up the region B includes the boundary of the region, then B 
is said to be closed. The function 


\/l — X* — p* 

is defined in the open region x* + y* < 1. 

The definition of continuity of a function of two independent 
variables is a generalization of the definition of continuity of a 
function of a single variable. Let /(x, y) be defined at the point 
(xo, po) and in a sufficiently small region about this point. If 

(22-1) lim/(x, y) = /(xo, yo), 

the function/(x, y) is said to be continuous at the point (xo, yo). 
The precise arithmetical meaning of the statement embodied in 
(^1) is the following: 


58 



FUNCTIONS OF SEVERAL VARIABLES 59 

If for any 'preassigned positive number e one can find a positive 
number $ such that 

\f(x, y) — fixo, 3/0) 1 < e, 

whenever \x — a:ol < 5 and \y — yoi < S, then the fundion is 
continuous. 

Geometrically this means (Fig. 15) that one can find a square 
about the point (xo, yo) so small that the difference between the 
values of the function at {xa, yo) 
and at any other point (rc, y) 
within the square will be in 
absolute value less than any 
preassigned number 

Inasmuch as nothing is said 
in the definition (22-1) about 
the manner in which and 

y yo, the limit must exist for 
any mode of approach to 
(*o, Va). 

A function that is continuous 
at every point of a region R is said to be continuous in the region 
B. If the region is closed, the function is continuous in the 
clpsed region. For example, u = \/l — — y^ is continuous 

within and upon the boundary of the region bounded by the circle 

-f y2 = 1. 

Only real functions of real variables x and y are considered 
in this chapter. There are theorems regarding such functions 
that are entirely analogous to those given in Chap. I for functions 
of a single variable. The more important of these are the 
following:* 

Theorem 1. If fix, y) is continuous at {xo, yo) andfixo, yo) 9 ^ 0, 
then one can find a region about the point (xo, yo) smh that fix, y) 
has the same sign as fixo, yo) throughout the region. 

Theorem 2. A function fix, y) that is continmus in a closed 
region is hounded in that region. 

Theorem 3. If fix, y) is continuous jn a closed region, then 
there exists in this region at least one point (x, y) at which fix, y) 

The reasonmg used in establishing the validity of these theorems is of 
the same character as that employed in proving the corresponding theorems 
for fimctions of a single variable. 




ADVANCED CALCULUS 


60 


§22 


takes iU maximum value and at least one point where it assumes its 
minimum value. 

Theorem 4. If u and v are continuous functions of x and y, and 
if z is a continuous function of u and v, then z is a continuous 
function of x and y. 

The definition of uniform continuity of a function of two 
variables is as follows: 

If for any preassigned positive number e, one can find a positive 
nurnber 5, the same for the entire region R, such that 

yi) - f(xi, 2 / 2)1 < «, 

for every pair of values (xij yi) and {x 2 y 2 / 2 ) ihat satisfy the ineguali- 
ties \xx — x^l < b and \yi - 2 / 2 I < 5, then f(x, y) is uniformly 
continuous in R. 

A function of two variables that is continuous in a closed 
region R can be shown to be uniformly continuous in R. 

The extension of these definitions to functions of more than 
two variables is immediately obvious. If 

« = /(a:, y, z), 

the triplets of values {x, y, z) can be associated TOth the points 
of three-dimensional space. The square region |a: — a:o| < S and 
\y — 2/o| < S used in the definition of continuity of f{x, y) must 
be replaced by a cubical region defined by the inequalities 

|x — xol <5, \y — 2/0I < 5 , \z — 2o| < 5. 

If the fimction u depends on more than three independent 
variables, the usual geometrical interpretation of the independent 
variables as the coordinates of points in ordinary space fails, 
but the geometrical language may still be used. Thus 
w = /(iKi, * 8 , x^, where x\, Xj, x*, and xa are four independent 
variables, may be thought of as defined over a four-dimensional 
manifold, and the quadruplets of numbers (xi, X 2 , xj, X 4 ) may be 
associated with the points of a hyperspace. 

A continuous function u = /(x, y) of two independent variables 
X and 2/ is a continuous function of each of the variables taken 
separately. Thus, if the value of onei of the variables is fixed 
by setting y = 3 / 0 , the resulting function of the single variable x, 
namely. 


« = /(*, yo), 



FUNCTIONS OF SEVERAL VARIABLES 


61 


is obviously coutinuous in x. . The fraiiverse of this statement 
may not be true, however. For example, let 


y) 


unless . - 0 »id - 0 simoltaneously, 

: 0, if a; = 0 and 2 / = 0. 


Then for any fixed value of y (or x) the resulting function of a 
single variable is easily shown to be continuous. However, 
f{x, y) is not a continuous function of the two variables x and y 
at a; == 0 and y == 0. To show this, it will suflSlce to demonstrate 
that there exists one mode of approach toward the origin for 
which lim /(rc, y) 9 ^ 0. Let the point {x, y) approach (0, 0) 
along the line y ^ x. Then 


lim - 
*-♦0 ^ 

l /-^0 


2 xy 
+ y^ 


2x^ 


1 , 


whereas f{x, y) is defined to be zero at the origin. 

A word of caution is in order in regard to the meaning of the 


symbols: 

(a) 

lim/(a:, y), 

X—^ZO 

1/—>yo 

Q>) 

lim Um f(x, y), 

x-*xo y—^ytt 

and 

(c) 

lim lim/(a:, y). 

y—>1/0 x—*xo 


The limits in (6) and (c) are called the repeated or iterated limits, 
and the order of the two separate limiting processes in (6) and (c) 
cannot be interchanged in general. Thus, consider 


Then 


while 



1. 
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The limit in (a), on the other hand, must exist for any con¬ 
ceivable mode of approach of y) to {xq, yo). Hence, if the 
limit in (a) exists, the corresponding limits in (6) and (c) will 
exist and will be equal if the inner limits exist. The converse, 
however, is not true. The repeated limits (6) and (c) may exist 
and he equal, and yet the limit in (a) may fail to exist. 

PROBLEM 

Show that/(aj, y) - , -rr is a continuous function in each 

^ _ yy 

of the variables taken separately but is not a continuous function of both 
variables at (0, 0). 

23, Partial Derivatives. Let u = f(x, y) be a single-valued 
function of the independent variables x and y, and let it be defined 
at some point (xoj 2 / 0 ) and for all values of (a;, y) in some regionf 
R about the point (a;o, 2 / 0 ). If y is set equal to yo, u becomes a 
function of the single variable x, namely, 

w = fix, yo). 

If this function has a derivative with respect to the variable x, 
the derivative is called the partial derivative of f(x, y) with 
respect to x, for y = yo- In like manner, if x is assigned a con¬ 
stant value Xo, the derivative with respect to y of the resulting 
fxmction /(xo, y) is called the partial aerivative of f(x, y) with 
respect to y, for x = xo- The customary notations for the partial 
derivative of w = f(x, y) with respect to x are: 

/.(aj, y), and 

The partial derivatives of a function /(xi, Xj, • • • , *„), of 
n independent variables, are obtained by fixing the values of 
^ “ 1 of the variables and calculating the derivative of the 
resulting function of a single variable. Thus, 

fix, y, z) = yx* — 2yx -f xz* 

• See in this connection Hobson, E. W., Theory of Functions of a Heal 
Variable, p. 408. 

tAn^ogous to the definition of the “neighborhood" or “vicinity” of a 
pomt given in Sec. 3 for a function of a single variable, the totality of all 
points whose distance from a given point P is less than a given number 
. > 0 is called a neighborhood ef die point P, 
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= 2xy -2y + 2 *, 

By 
Bz 


— 2x, 
2xz. 


Recalling the definition of the derivative of a function of a 
single variable, one can see that the expressions 

— = lim /(^° + K yo) — f(Xo, yo) 

dx h ’ 

and 

— = Urn yo + h) — fjxo, yo) 

dy h-Mi h ’ 

define the partial derivatives of f{x, y) at the point (*o, yo). 

Even though the notation ^ suggests a fraction, it must be 

noted carefully that it is merely a symbol for the partial deriva¬ 
tive, which does not find a sensible interpretation as a quotient 
analogous to that given for the ordinary derivative. 

Let Aw denote the change in the value of w = f(x, y) when x 
and y acquire, respectively, the increments Ax and Ay. Then 

(23-1) Aw = f(x +Ax,y + Ay) - fix, y). 

Adding and subtracting fix, y -j- Ay) in the right-hand member 
of (23-1) give 

Aw = [fix + Ax, y + Ay) — fix, y + Ay)] + [fix, y -)- Ay) 

- f ix, y)]. 

The expression in the first bracket represents the increment 
received by the function fix, y + Ay) when x undergoes a change 
of magnitude Ax-, whereas the second bracket gives the increment 
of the fimction fix, y) when x is kept fixed. 

The application of the mean-value theorem gives 

fix -f Ax, y + Ay) - fix, y -[- Ay) = /.(x + Ax, y -b Ay) Ax, 
fix, y + Ay) - fix, y) = /,(x, y -f- Ay) Ay, 


where and Bt are numbers between 0 and 1. Then Aw can 
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be written in the form 


(23-2) Au = fs(x + ffi Ax, y + Ay) Ax Sy(x, y + 6^ Ay) Ay. 

If it is assumed that the partial derivatives /, and fy are 
continuous functions of x and y, then 


lim /*(a: ■+• 6i Ax, y + A^) = /,(a:, y), 

Aa ;-^0 

Ay—^0 

and 

lim fv{x, y + 01 Ay) = fyix, y). 

Ay-*0 

The last two equations can be rewritten to read 


(23-3) 


(Mx + 01 Ax, y + Ay) = U{x, y) -b tJi 
y + 0i Aj/) = Sy(x, y) -t- r,!, 


where 171 and rii tend to zero when A* —>■ 0 and Ay ■ 0. 

Substituting from (23-3) in (23-2) gives 


(23-4) Aw = Ax -f ^ Ay -b iji Aa: -b »;2 Ay. 

The sum of the first two terms in the right-hand member of (23-4) 
is called the prindpcd part of the increment Au, or the total 
differential of u, and is denoted by the symbol 

( 23 - 6 ) ^ 

As in the case of a function of a single variable, the increments 
and the differentials of the independent variables are identical, 
so that dx s Ax and dy = Ay, 

Since vn and 172 are functions of Ax and Ay that tend to zero 
with Ax and Ay, the expressions 

7)1 Ax and ^2 Ay 

are infinitesimals of higher order* than Ax and Ay. Accordingly, 
for small values of Ax and Ay, the value of Au is very nearly that 
of dw.t 

* It will be recalled that a variable whose limit is zero is called an wfinu 
ieaimal. If lim~ ** 0, where « and /S are infinitesimals, a is said to be of 

higher order than 
t See Prob. 6, p. 66. 
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Formula (23-4) is analogous to that developed in Sec. 15 
for the increment of the function of a single variable x, where it 
was found that 

A^/ = f{x) Ax + rj Ax. 

Since u == f(x, y), (23-6) can be written as 


, , du . , du j 

(23-6) du = -^dx + ^dy. 

The extension of formula (23-6) to functions of any number of 
variables is immediate. If ti = f(xi, xi, • • • , Xn), where 
xi, xt, ' • • , x„, are the independent variables, the differential 
of M is defined as 


j du j , du , . 

du = -r— dxi -j- -r— dXi -h 
dXi dXi 


^ dx„ “ 


(23-7) 

Theorem. If Xi, Xi, • • • y Xn are independent variahles and 
u =/(xi, X 2 , • * • , Xy) is continuous together with its partial 
derivatives, and if 


(23-8) du == Piixi, X 2 , 

then 


Pi- 


du 


■••,*„) dxi + Pt(xi, Xi, • 
-h • • • -H PnQCi, Xi, • 

p, - i!i, . . . p = i!i. 

" dXi ’ “ dx„ 


Since the variables are independent, one can set 


dxi = dxt = 


= = 0 


, Xn) dXi 
3 fn) dXnp 


in (23-7) and (23-8) to obtain 


du = dxi = Pi dxi 
dxi 


Thus 


Pi = and so forth. 
dxi 

. 1 . 3^* 

Corollary. If du — 0, then ^ - 


du 


dxi dXi dXn 

PROBLEMS 

1. Find the partial derivatives of the following functions: 


s 0. 


(o) log (x’ + y* -h **); 
(6) e* cos xy; 

(c) X* - 3x*v + **; 
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(/) sin- 


e» + e*’ 


(s) tan-i-; 

(h\ till- 
X -r y 

(i) e“* sin y. 

Find the differentials of the following functions; 

(а) (x^ + y^ + z^)^; 

(б) (a* + y^ + z^)-yi-, 

(c) X log (x* + 2®); 

(d) log tan (x* + y*)', 


’ x + y 

3 . What are the values of the partial derivatives of 

- 2 ! — y + 1 
” X + y — 1 

at ( 0 , 0 )? 

4 . Find the partial derivatives of 

X — r cos S sin <pj 
y = r sin & sin <p, 
z — r cos Of 

with respect to r, 6, and 
6 . If w = -f y*;? + verify that 

du , du , du . , , 

E + ai; + S-‘’ + '' + '>’- 

6 . It was remarked in Sec. 23 that for small changes in che values of 
the independent variablefik the change in the value of the function is 
nearly equal to the magnitude of the differential. This fact can be used 
to calculate the approximate error in the quantity f(z, y, z) determined 
by measurements of x, y, and z. The error in /, due to small errors 
di, dy, and ds in x, y, and is approximately equal to 

Show that the approximate relative error y is equal to d log/. 
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7. Referring to Prob. 6, find the approximate error in calculating 

the area of a triangular piece of land, two sides of which are measured 
as 125 and 100 ft., respectively, and the included angle as 60.“ The 
possible error in meastiring the sides is 0.2 ft. and that in the measure 
of the angle is 1“. Hint: A = sin a. Am. 74.0 sq. ft. 

8. In estimating the cost of a pile of bricks measured as 6 X 50 X 4 ft., 

the tape is stretched 1 per cent beyond the estimated length. If the 
count is 12 bricks to 1 cu. ft. and bricks cost $8 per thousand, find the 
error in cost. Am. $3.46. 

A 

9. In determining specific gravity by the formula a = where 

A — W 

A is the weight in air and W is the weight in water, A can be read within 
0.01 lb. and JV within 0.02 lb. Find approximately the maximum error 
in s if the readings are A = 1.1 lb. and W = 0.6 lb. Find the maYimnm 
, As 

relative error — Am. 0.112; 0.054. 

s ' 

10. The period of a simple pendulum with small oscillations is 



If T is computed using i = 8 ft. and g ^ Z2 ft. per second per second, 
find the approximate error in T if the true values are I = 8.05 ft. and 
g = 32.01 ft. per second per second. Find also the percentage error. 

Am, O.OOStt; 0.3 per cent. 

11, The diameter and altitude of a can in the shape of a right circular 

cylinder are measured as 4 in. and 6 in., respectively. The probable 
error in each measurement is 0.1 in. Find approximately the maximum 
possible error in the values computed for the volume and, the lateral 
surface. Ana. 1.67r;7r. 

12. Show that the relative error of the product is equal to the sum of 
the relative errors of the factors. 

24. Bifierentiation of Composite Functions. Let u = y) 

be a function of the variables x and y which in turn are functions 
of some independent variable L If t is given an increment M, 
the functions x and y will acquire increments Ax and Ay, and, 
consequently, u will receive an increment Au. 

Assuming that u = /(x, y) is continuous together with its 
partial derivatives, one can write [see (23-4)] 

Att = Ax + Ay + >71 Ax + ij* Ay. 

Dividing both sides of this expression by M gives 


Au duAx . duLy 


Ax 


Ay 
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Now if it be supposed that x and y can be differentiated with 
respect to t, the expression (24-1) gives, upon passing to the limit 
as Af —> 0, 

du _ du dx . du dy 
^ dt ~ dx dt dy dt 

_^dx 

” dx dt dy dt ’ 

since ^ 0 and ri^ 0. The reason for the vanishing of 
and as 0 is that r)i and 072 are functions of Ax and Ay, 
and since x and y are assunaed to be differentiable functions of t, 
they are surely continuous in t. 

Formula (24-2) gives the rule for the differentiation of com¬ 
posite functions. It is clear that if is a function of a set of 
variables, xi, X2, • • • , Xn, where each variable is a function of 
an independent variable tj the derivative of u with respect 
to t is given by the formula 

du _ ^ 4. ... 4. 1^ 

dt dxi dt 6 x 2 dt dXn dt 


A special case of formula (24-2) is of interest. If it is assumed 
that t — Xj (24-2) becomes 


(24-3) 


du _ du , du dy 
dx dx dy dx 


Formula (24-3) can be used to calculate the derivative of the 
implicit function given by 


(24-4) f(x, y) = 0. 

Let it be assumed* that (24-4) can be solved for y to yield a 
real solution 

(24-6) y = <p(x); 

then the substitution of (24-5) in the left-hand member of (24-4) 
gives an identity 0 = 0, or 


f[x, <p(a:)] = 0. 

Thus the constant zero defines an implicit function of x, namely, 

• For general theorems regarding the conditions to be satisfied by /(*, y) 
if solution is to be possible, see Chap. XII. 



§24 FUNCTIONS OF SEVERAL VARIABLES 


(24-6) 0 = /(x, y), where 

Applying (24-3) to (24-6) gives 


y - <p(x). 


0 = ^- 1 - 

dx ~ dy dx’ 


and solving for 


(24-7) 


dy _ dx 

dx ~ ^ 

dy 


d'f 

The formula (24-7) implies that ^ must not vanish for the 

point (xo, yo) at which the derivative is calculated. 

Example 1. Let/(x, y) — 3x®y* -1- x cos y = 0. 

^ = 9 x^y^ + cos y, ^ Qx^y — x Bmy, 

so that 

dy _ 9 a; 2 y 2 ^ y 
dx 6 x^y — X sin y^ 

for all values of x and y that satisfy the equation 
, 3x^y^ + X cos 2 / = 0, 
and for which 6 x^y — x sin y 9 ^ 0 . 

Example 2. Let x^ + y^ = 0 ; then ^ 
it does not follow that 


dy _ 
dx ~ y 

This result is absurd inasmuch as the only real values of x and 
y that satisfy x* -f y* = 0 are x 0 and y = 0. Since ^ 

dti 

vanishes at this point, the formal procedure used in obtaining ^ 
is meaningless. 
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Example 3. tet /(a;, t/) = 0 represent the locus of some curve 
and let P{x^, yo) be some point on the curve. The equation of the 
tangent line to the curve at the point P is 



It follows from (24-7) that this equation can be written in the 
form 

fxiooa, yo)(x - xo) + fy{xo, yo)(y - yo) - 0 . 


PROBLEMS 

1. Find the equation of the tangent line to the ellipse 



at the point (xo, yo). 

2 . Find the equation of the tangent line to the folium of Descartes 
a;® + V® — Saxy = 0 . 

Note particularly the behavior of the tangent line to the folium at (0,0). 


3. Find if 
dt 


tan' 


-lU 


and 


(y - e* + e-* 

= e* — 

4. Find the equation of the tangent line to the ellipse . 


a; = a cos d, 
V = 6 sin df 


at the point where 6 — 



6 . (a) Find if w = e* sin yz and x = f — 1 , J 8 = 

— 4y*, X - r Bee $, and j/ « r tan 9. 


1 


(b) find — and ■—» if u 


du du 

6 . (o) Fmd ^ and if « = »* + y’ and y = tan x; 

(b) given V = /(*, y, z), where a; = r cos fl, y = r sin 0, 

, , . dV dV dV. ^ ,dV dV ^dV 

z = t] compute in terms of and 

_ 7. The equation of a perfect gas is pi> = RT. At a certain instant a 
given amount of gas has a volume of 16 cu. ft. and is under a pressure of 
36 lb. per square inch. Assuming R = 10.71, find the temperature T. 
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If the volume is increasing at the rate of H cu. ft. per second, and the 
pressure is decreasing at the rate lb. per square inch per second, find 
the rate at which the temperature is changing. Ans. 53.78; 0 . 93 . 

26. Differentiation of Composite and Implicit Functions. The 
reasoning employed in the preceding section can be applied in 
obtaining the total differential, and hence the derivative, of a 
function of n variables 

M = fi^i, *2, • • • , a;„), 

where 

Xi = Xi{t), (i = 1 , 2 , • • • , n), 

are n differentiable functions of a single variable t. 

The resulting expression for the total differential is 

(25-1) du = dx, +-^^dxi+ -I- ^ dx„. 

A question iirises concerning the validity of formula (26-1) 
in the case where the variables x,- are functions of several inde¬ 
pendent variables fi, fa, • • • , fm. Thus, let 

(25-2) U = /(Xi, X 2 , ‘ , Xn) 

be a function of the n variables x<, where the x* are functions 
of the variables fi, fa, • • • , fm, say 

(25-3) Xi = x,(fi, f 2 , , U, {i - 1, 2, , n). 

If all of the variables except one, say 4, are held fast, (25-2) 
becomes a function of the single variable U and one can calculate 

the derivative ^ with the aid of (25-1). The notation —j 
otk atk 

instead of is used to signify the fact that all variables except 

4 are held fast. 

Assuming the continuity of the derivatives involved, one can 
write 


df 

M. 

dxi 

+ 

d/ 

dX2 

+ 

-1- 

df 

dx„ 

dh 


dtl 

dX2 

dh 

dx„ 

dtl 

^ _ 

_ y 

dxi 

+ 


dX2 

+ • ■ 

■ • + 

df 

dXn 

ati 

dxi 

ati 

dX2 

dt2 

dXn 

ati’ 

V _ 


dXx 

+ 

k 

dX2 

+ • • 

■ • 4- 

df 

dx„ 

dU " 

dx\ 

dim 

axi 

dt„ 

dXn 

dC 
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If . . . , be multiplied respectively by dti, dt^, 

dti dti 

- ■ • , dtm. and the resulting expressions added, one obtains 






+ 

+ 

+ 


dti + dti 4“ 


+ 


(dXj 
dX2\dti 


dx 

dtfn 

dx 


dti 


+ —dt, 




dti+ ^ dti + 


+ 


to, 

dt, 


;*■) 
•) 


dXn\dh'^^ ' dti 

The left-hand member of this expression is the total differential 
off(xi, Xi, • • • , x„), regarded as a function of the independent 
variables h, fi, • ■ • , fm, whereas the terms in the parentheses 
in the right-hand member are precisely the total differentials of 
(25-3). Hence, one can write 






which shows that the formula (25-1) is valid whether the X{^8 are 
the independent variables or are functions of any set of other 
independent variables. 

The foregoing can be summarized as follows: 

Theorem. If % — f(xij Xi, • • ^ , Xn), 


then 




+ 


dXn 


dXn 


regardless of whether the variables Xi are the independent variables 
or are functions of other independent variables 4* It is understood 

that all the derivatives involved ( the and j are continuous 

\ dXk dtk/ 


functions. 

Example, If f{xj y) — x'^ + where a; == r cos ^ and 
y ^ r sm. <pj then 


^ y ^ I 

dr dx dr dy dr 


2x cos ip + 2y sin <p 
2r cos^ ^ -h 2r sin^ <p 


2r, 
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y y to , ^ ^ 

to d(p dy d<p 

Also 

df = 2r dr 


2x{—r sin <p) + 2y(r cos tp) 

—2r* cos y; sin + 2r* cos ^ sin ^ 

or dS = 2xdx + 2y dy. 


0 . 


Let /(*, j/, z) = 0 define any one of the variables as an implicit 
function of the remaining ones. If x and y are thought to be the 
independent variables and one can obtain* (at least theoretically) 
a real solution for z in terms of x and y, it is pqssible to write 


But 




Substituting the value of dz in this equation gives 

|dx + |d2/ + |(; da:+gdl/) = 0, 
or 

\dx ^ Sz dxj ^\dy^ dz dy) ^ 

By the corollary to the theorem of Sec. 23, since x and y are 
independent variables, 

dx dz dx 

and 

^ = 0 
dy dz dy 


If 5^ 0, these 
dz 


equations give 


(26-4) 






dz 

dx 

to ^ _ 

ay 

to 

a/ ' 

dy 

■ ^ 


dz 


dz 


The formulas (26-4) permit one to calculate the partial deriva¬ 
tives of the function z defined implicitly by an equation 


f(x, y, z) = 0. 


* See Sec. 113. 
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As an illustration, let 

a:* + — 3xz + 1 = 0. 

Then, by (25-4), 

dz 2x — 3z j dz 4y 
dx —3x dy —3a: 


PROBLEMS 

Qu du 

1. Find — andifw = — iy^x = rsec^,andv = rtan^. 

or ou 

2. If 7 = fix, y, z), where x = r cos 6, y = r ain d, z = t, find 

dr' dS' dt 


,dV dV ,67 

m terms of —» and 

dx dy dz 

3. (a) Find if rc sec y + a;® 2 / = 1; 
ax 

(d) find ~ and if 
dx dy 


x^y — sin 2 + 


0 . 


4. If/is a function of u and v, where w == \/x* + y* and v *» tan*"^ 



6. If/is a function of u and v, where t* * r cos 6 and » r sin 6, find 


dfdf 

IT* ’TV 

dr dB 



6. K a; = a/ cos d — y' sin 6, y = x' sin 6 + y' cos 0, prove that 


7. Find the total differential, if « - a:* + y*, a; •> r cos 0, and 
= r sin d. 

8. If/ = e*», where x ■= log («• + »*) andy - tan“' ^ find^ and" 
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AT* v,-\- V . . ,dz . dz 

9. If z = --) u — y sm x, and v = e**, find -zr and tt' 

1 — Mt) ’ dx dy 

10. Find and if z = f ^ , x = tan (r — s), and y = e". 

dr as 1 + xy n » 


26. Euler’s Theorem. A function/ of n variables xi, xa, ■ • • , 
is called homogmeous of degree m, if upon replacement of each of 
the variables by an arbitrary parameter X times the variable, 
the function / is multiplied by X™. In S 3 nmbols this means that 
(26-1) /(Xxi, Xx 2 , • • • , Xxn) = * 2 , • • • , x„). 

Thus, 

fix, y, z) = a:* — 2/2 — 2 z* is homogeneous of degree 2 , 
f(x, y) ''y^ — X* sin~^ - is homogeneous of degree 1 , 

y 




fix, y, z) = 


f X* -1- 


is homogeneous of degree 0, 


is homogeneous of degree — 


Theorem. If f(xif X 2 , • * • , x^), with contimums 'partial 
derivatives^ is homogeneous of degree m, then 




+ X™ ^ = «/(Xi, X2, 


In order to prove this theorem, set 

x'l — Xxi, xj = Xx 2 , • • • , x' = Xx„. 
Then, since / is homogeneous of degree m, 

fWu X't, • • ■ , XO = X”/(Xi, X2, • • • , x„). 
Differentiating with respect to X one obtains 




+ ^ X« = mX^-i/Cxi, X2, 


and setting X = 1 gives the desired result (26-2) since 


PROBLEM 


Verify Euler’s theorem for 

(«) /(», y) = Vy* - S'* 
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(6) /(*. y, 2 ) = + 2a:j/z; 

(c) /(as, ?/) = e*'''': 


W /(®, y) 


/'3> + y . 


(e) M y) 


a?^ + 


27. Directional Derivatives. The relation expressed in (24-2) 
has an important special case when x and y are functions of the 
distance s along some curve C, which goes through the point 
(a;, y). The curve C may be thought to be represented by a pair 
of parametric equations 

X = x(s)j 

y = 2 /(«), 


where x and y are assumed to possess continuous derivatives with 
respect to the arc parameter s. 



Fig. 16. 


Let P (Fig. 16) be any point of the curve C at which /(x, y) is 
defined and has partial derivatives ^ and Let 


Qix + Ax, y + Ay) 


be a point close to P on this curve. If As is the length of the 
arc PQ and Af is the change in / due to the increments Ax and 
Ay, then 


ds 


■ lim 


Af 


A.—*0 As 


gives the rate of change of / along C at the point (x, y). But 




dy 
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dx T Ax 
■j- = lim — 
as As 


cos a, 


as As 


sin a. 


Therefore, 

(27-1) 


ds 


cos a sin a, 
da; dy ^ 


df 


and it is evident that ~ depends on the direction of the curve. 


For this reason 


ds 


is called the directional derivaiive. It 


represents the rate of change of/in the direction of the tangent to 
the particular curve chosen for the point (Xy y). If a = 0, 


ds 


dx 


which is the rate of change of / in the direction of the a:-axis. If 

IT 


y] 


ds 


ef 

dy 



C+aC 


which is the rate of change of/in 
the direction of the y-axis. 

Let z = /(a:, j/), which can be 
interpreted as the equation of a 
surface, be represented by draw¬ 
ing the contour lines on the xy- 
plane for various values of z. Pio. 17 . 

Let C (Mg. 17) be the curve in 

the *|^-plane corresponding to the value z = y, and let C 4 - AC be 

Af Ay 

the neighboring contour line for z = y + Ay. Then ^ ^ ^ 

the average rate of change of / with respect to the distance As 
between C and C -j- AC. Apart from infinitesimals of higher 
order, 

An 


As 


= cos 4'} 


where An denotes the distance from C C + AC along the nor- 
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mal to C at (x, y), and ^ is the angle between An and As; hence 
— = cos 4'' Therefore 


(27-2) 


ds dn ds dn 


cos lf>. 


This relation shows that the derivative of / in any direction may 
be found by multiplying the derivative along the normal by the 
cosine of the angle between the particular direction and the 
normal. This derivative in the direction of the normal is called 
the normal derivative of /. Its numerical value obviously is the 

maximum value which ^ can take for any direction. In applied 
mathematics the vector in the direction of the normal, of magni¬ 
tude is called the gradient 

Example. Using (27-1) find the value of a which makes 
^ a maximum, considering x and y to be fixed. Find the 

expression for this maximum value of ~ 

Since ^ ol + fy sin a, 


da\dsj 


-fx sin a + /y cos a. 


The condition for a maximum requires that 


tan ax = 
Using this value of ai, 

fat 


ai = tan~‘ Y’ 

Jjo 


VJf+H. 


The relation (27-2) can be derived directly by use of this expres¬ 
sion for If a (Fig. 18) gives any direction different from the 
direction given by ai, then 


= /, cos a -f- /„ sin a. 
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ds 


= /»(cos ai cos ^ + sin «! sin 


Since 

and 


cos «! 


+ /»(siu ai cos ^ 

— cos oi sin 4). 


sin «! = 


y/Sl+si 





+/. 


Fio. 18. 

cos 1^' + /, 


COS f — 


vjf+n 

fx 


sin ^ 


Vfs+fy'"^ Vlf+Ji 
= COS i/' = VSl+fl cos if 

vjmi 

df 


sin ^ 


dn 


cos 


probi:;bms 


1. Find the directional derivative of/(«, y) = a;*i/ + sin at 

in the direction of the line making an angle of 45® with the x-axis 

2. Find 

df 


(‘•i> 


dn-yl(M) +(J9’ 

if X = r COS y — r sin 6, and/ is a function of the variables r and 0* 
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3 . !Find the directional derivative of /(a;, y) — in the direc¬ 

tion of the curve which, at the point (1,1), makes an angle of 30° with 
the ®-axis. 

4. Eind the normal derivative of f{x, y) = + y^. 

28. Tangent Plane and Normal Line to a Surface. It will be 
recalled that 

Ax + By Cz = D 

is the equation of a plane, where the coelEcients A, B, and C 
are called the direction components of the normal to the plane. 



If a, fi, and y (Fig. 19) are the direction angles made by the normal 
to the plane from the origin, then 

+ 5* + C*’ ^ V~A^ + B^ + C*' 

Therefore, 

cos a:cos /3:cos 7 = A:\B:C. 

If the plane passes through the point (xo, Tfo, zo), its equation can 
be written as 

A(x — * 0 ) + B{y — yo) + C{z — 2o) = 0. 

There is also a normal form for the equation of a plane, entirely 
analogous to the normal form for the equation of the straight 
line in the plane. This form is 


X cos a + y cos |3 + z cos 7 = p. 
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or 


. V/ 

+ B^ + C*‘ 
D 


Va* + -b* + c* 


in which p 


D 

VA^ + B* + C* 


the distance from the origin 


to the plane. 

Consider a surface defined by a = f{x, y), in which x and y 
are considered as the independent variables. Then 


(28-1) 


dz = 


* 


If xo and j/o are chosen, zb is determined by z =/(x, y). Let 
Ax = X — ®o and Ay = y — yo, and denote dz by z — Zo. Then 
(28-1) becomes 


(28-2) z 


(»o, yo) <^i 


(X6, Ifo) 


- ^o), 


which is the equation of a plane. If this plane is cut by the 
plane x = xo, the equation of the line of intersection is 


^0 — ■^T'l 

yo) 


(.y - yo), 


and this is the tangent line to the curve z = f{xo, y) at the point 
(a;o, 2 / 0 , «o). Similarly, the line of intersection of the plane defined 
by (28-2) and the plane y = 2/0 is the tangent fine to the curve 
z == /(x, 2 / 0 ) at (xo, 2 / 0 , 2o). The plane defined by (28-2) is called 

the tangent plane to the surface 

$ 

* = fix, y) 


at (xo, yo, Zo). 

The direction cosines of the normal to this plane are propor¬ 
tional to 


dx 


f 

(xo, yo) 


2f 

dy 


J 

(»Oo yo) 


- 1 . 
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The equation of the normal line to the plane (28-2) at (a:o, yo, Zo) 
is therefore 


(28-3) 


X — xq _ y — y» _ z — zq 


df 


3 / 

^ -1 

dx 

(xo, yo) 

dy 

(»o. yo) 


This line is defined as the normal to the surface at {xo, yo, zo). 
Figure 20 shows the difference between dz = RP' and Az = RQ. 



P(xo, yo, Zo) is the point of tangency and R(xo -f- Ax, yo + Ay, zo) 
is in the plane z = zo. PP' is the tangent plane. 

In case the equation of the surface is given in the form 

i^(x, y, z) = 0, 

the tangent plane and the normal line at (xa, yo, 2 ^ 0 ) have the 
respective equations 


SI 


and 

(28-6) 


(x - Xo) +1^' (y - yo) 

(«0i VOf fo) uy (xo, Vo, * 0 ) 

+ . (2 - Zo) = 0 

(xo, VOf mo) 


a; — Xo 


dF 


dx 

(®o, yo, Mo) 


j - yo 


Z — Zo 


If yo, Mo) \(xo, yot Mo) dz I (as*, yo, 


These equations follow directly from (26-4). 
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Example 1 . At ( 6 , 2 , 3) on the surface = 49, 

the tangent plane has the equation 

2x\ (x - 6 ) + 2y\ (y - 2) + 2z\ (z - 3 ) = 0 

I(6- 2, 8) 1(6, 2, 3) 1(6, 2. 3) 

or 

6 x + 22 / + 3z = 49. 

The normal line is 


x-6_y-2^z-Z 
12 4 6 ■ 

Example 2. For (2, 1, 4) on the surface z = x* + 2 /® — 1, the 
tangent plane is 

z - 4 = 2x1 (x - 2 ) + 2y\ (y - 1 ) 

1 ( 2 . 1 ) . 1 ( 2 . 1 ) 

or 

4x + 22 / — z = 6 . 

The normal line is 


X — 2_y — I z — A 
4 2 -1 ■ 

PROBLEMS 

1. Find the distance from the origin to the plane x + y + * = 1. 

2. Find the equations of the tangent plane and the normal line to 

(a) 2x* + 3y* + 4z* = 6 at (1, 1, H); 

^2 a /2 ^2 

(c) — + 7$ + "5 = 1 at (xo, 2/0, 2!o). 

or 0 ^ 

3. Referring to (28-4), show that 

^ BF BF BF 

cos a: cos p: cos y = 

dx By Bz 

where cos a, cos /3, cos y are direction cosines of the normal line. 

4. Show that the sum of the intercepts on the coordinate axes of any 

tangent plane to is constant. 

29. Space Curves. It will be recalled that a plane curve C 
whose equation is 

(29-1) 


y = f{x) 
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can be represented in infinitely many ways by a pair of parametric 
equations 


(29-2) 


X = x{t), 

y = y{t), 


so chosen that when the independent variable t runs continuously 
through some set of values h h, the corresponding values 

of X and y determined by (29-2) satisfy (29-1). 

For example, the equation of the upper half of a unit circle 
with the center at the origin of the cartesian system, 


can be represented parametrically as 
X = cos t, 

y = sin t, (0 ^ t rS ir), 

or 


or 

X — 2t, 

y = {QStS H)- 

Similarly, a space curve C can be represented by means of a 
set of equations 

X = *(0, 

(29-3) y = yit), 

z = z{t), 

so selected that when t runs through some set of values, the 
coordinates of the point P{x, y, z), defined by (29-3), trace out 
the desired curve C. 

It will be assumed that the functions in (29-2) and (29-3) 
possess continuous derivatives with respect to t, which implies 
that the curve C has a contmuously turning tangent as the point 
P moves along the curve. 

Let P(xo, Vo, Zo) (Fig. 21) be a point of the curve C defined by 
(29-3) that corresponds to some value to of the parameter t, 
and let Q be the point (xo -h Aaf, yo -h Ay, zo -|- Az) that cor- 
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responds to t = U + At. The direction ratios of the line PQ 
joining P and Q are 


^ ^ Az _ Ax Ay Az 
Ac'Ac'Ac At'At'At 

If At is allowed to approach zero, Ax, Ay, and Az all tend to zero, 
so that the direction ratios of the tangent line at P(xo, yo, 2o) 



are proportional to 



tion of the tangent line to C at P is 


Hence, the equar 


X — xo _ y — ya _ z — zo 
x'ito) ~ y\U) z'iU)’ 

where primes denote derivatives with respect to t. 

Example. The equation of the tangent line to the circular 
helix 


a; = o cos t, 
y = asm t, 
z = at. 
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at i == is 



a Vs ® 

2 -r" 


The element of arc ds is given by 

{dsY = + {dyY + {dz)\ 

so that the length of a space curve C can be calculated from 

The length of the part of the helix between the points (a, 0 , 0 ) 



30. Directional Derivatives in Space. There is no essential 
difficulty in extending the results of Sec. 27 to any nunaber of 
variables. Thus, if w == /(x, z) is a suitably restricted func¬ 
tion of the independent variables x, y, and z, then the directional 
derivative along a space curve whose tangent line at some point 
P(x, y, z) (Fig. 21) has the direction cosines cos (x, s), cos (y, a), 
and cos ( 2 , s) is 

du du . y . du . . . du , V 
^ - cos (x, S) + ^ cos (y, s) + -^ cos (z, s) 

"" dx ds dy ds dz ds 

The magnitude of the normal derivative is given by 

^ s=V(i)’+(|)’+(D’ 

PROBLEMS 

1 . Find the equation of the tangent line to the helix 
X = a COB tj y == a sin z ^ <d, 

at the point where ^ Find the length of the helix between the 

points t * 0 and t ** 7 * 

4 
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2 . Find the directional derivative of / = xyz at (1, 2, 3) in the direc¬ 
tion of the%ie that makes equal angles with the coordinate axes. 

3. Find the normal derivative oif - at (1, 2, 3). 

4. Show that the square root of the sum of the squares of the direc-. 
tional derivatives in three perpendicular directions is equal to the 
normal derivative. 

6. Express the normal derivative (30-1) in spherical and cylindrical 
coordinates, for which the equations of transformation are 

(a) a; = r sin 0 cos y = r sia 0 am z = r coa 0; 

(b) X = r sin 0, y = r cob 0, z - z, 

31. Partial Derivatives of Higher Order. The first partial 
derivatives of a function f(xi, X 2 , • • • , Xn) are functions of 
Xn and they may have derivatives with respect to 
some or all of these variables. These derivatives are called 
second partial derivaiives. 

If there are only two variables x and y the function u = /(x, y) 
may have the second partial derivatives 

dx dx dx^ 

dy dx dy dx 

d df _ d^f 
dx dy dx dy 

dydy dy^ ^ 

It should be noted carefully that fxu means that 

is found first and the result is differentiated with respect to 
dx 

dH dH 

y. Thus ^ A and differ in the order in which the differ- 
^ dy dx dx dy 

entiation is performed, and, consequently, the results may be 
different. The following theorem, due to Schwarz,* states 
sufl&cient conditions for inversion of the order of differentiation. 

Theorem. If ft^, fy, and fxy exist in the vicinity of the point 
{x, y) and if fxy is continuous at (x, y), then fyx exists at this point 
and is identical vdth fxy 
Form the function 

(31-1) v(x) = f(x, y + h) - f(x, y), 

* Db la ValiJib Poussin, C. J., Cours d'analyse iufinit^simale. voL 1, 
p. 146. 
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which for a fixed y and h satisfies the conditions of the mean- 
value theorem. Hence, making use of (20-4), 

<p{x + A) — <p{x) = + ^yh) 

= ^[/»(a: + dih, y + k) — -f- hh, y)], 

where 0 < fli < 1. 

The expression in the brackets is a function of y to which the 
mean-value theorem is applicable, so that 

/,(a: -f dih, y + k) — f^ix + dih, y) = lcf,v(x -4- Oih, y -f ejc). 
Since fxt is assumed to be continuous at {x, y), 

+ 9ih, y + dik) = f^(x, y) -f e, 

where 

lim 6 = 0. 

A-*0 

A--+0 

Therefore, 

(31-2) >pix -I- A) - (p{x) = hk[fm,{x, y) -f e]. 

From the defining equation (31-1) it is seen that (31-2) is 
equivalent to 

Six + h,y + k).-S{^ + h,y) — fix, y k) + fix, y) 

= hklS^ix, y) -+■ e]. 

Dividing through by k gives 

fix + h,y + k) -f(x + h, y) fjx, y + k) - fjx, y) 
k k 

= M/w(a:, y) + «]. 

Passing to the limit as fc —> 0, one obtains 

fyix + h,y) - fyix, y) = hf^^ix, y) -f A lim e, 

As—».0 

or 

Mi+A, !<)-/.(». V) _ „) + to 

tl 

The limit of this expression as A 0 is 

Svxix, y) = fyyix, y). 

Thus the order of differentiation is immaterial if the assump¬ 
tions regarding the partial derivatives are satisfied. These con¬ 
ditions certainly will be satisfied if it is known that /, and /, 
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possess derivatives /a* and which are continuous functions. 
The theorem is true tmder less restrictive conditions, but the 
detailed statement of these conditions is so involved that it will 
not be given here.* 

From the result just established it is clear that 
fxxt/0^) y) ~ SvxxiX] y)f 

if these partial derivatives are continuous. For 

y) Qydx dx dy ~ ” /»«*(*) y)- 

32. Higher Derivatives of Implicit Functions. The problem of 

calculating the derivative of y with respect to x when y is an 
implicit function of the independent variable x defined by 

(32-1) fix, y) = 0, 

was discussed in Sec. 24. It was shown there that 

(32-2) f^(x, y) -F f^(x, y) ^ 0. 

Differentiating this equation again and assuming that all the 
derivatives involved are continuous functions of x and y, gives 

(32-3) f^ix, y) + 2f^{x, y) ^ +fmix, y)(^ 

+ fv(^> y) ^ 0. 

If /if(®> y) 5^ 0 af tlie point where the derivative is desired, 
(32-3) can be solved for ^ and the value of ^ substituted 
from (32-2). The result is 

_ _ fxafti ^fxufxfy ~H finifx 

dx^ fl 

The process can be continued to obtain the derivatives of higher 
orders. 

A similar procedure can be employed to calculate the partial 
derivatives of a function z of two independent variables x and y 
defined implicitly by an equation of the form 

(32-4) f(x, y, z) = 0. 

* See E. W. Hobson, Theory of Functions of a Real Variable, vol. 1, 
pp. 424-429. 
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Differentiating (32-4) with respect to x and y in turn gives 


(32-5) 


/.(a;, y, 2 ) + /.(a:, 2') ^ 

f«(x, V, 2 ) + /.(a:, = 0. 


ff ftix, y, z) does not vanish for those values of x, y, and z that 

satisfy (32-4), then Eqs. (32-5) can be solved for and ~ 

Partial derivatives of higher order can then be obtained by differ¬ 
entiating equations (32-5). 

• Example. Let it be required to find the derivatives of second 
order of the function z defined implicitly by the equation 


£! + £' + , 

a* -I- 1- c2 


1 . 


Differentiating this equation with respect to x and y gives 


(32-6) 


2x 2zdz _ ^ 

^ _ 

dy 


Differentiating the first of Eqs. (32-6) with respect to x and y, 
one obtains 



^ c* to* 


4- 

dx dy dx dy 


Solving for and 


d^z 
dx dy 


and making use of (32-6), one obtains 


d^z _ + c^x^ 

dx^ 2 * 

dh _ xy 

dx dy 

In a similar way the differentiation of the second of Eqs. 
(32-6) with respect to y yields 
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PROBl^MS 
ay 


1. Verify that “ •' for 

dx ay ay ax 

(а) / = eos*y»; 

(б) / = sin* X cos y; 

(c) / = e*/*; 

(d) / = (** + 

(e) / = (®* — 2y)* + 

2. Prove that if 

(a) /(a:, y) log (** + y») 4- tan-* ^ then 0; 

X a®* a^* ' 

(&) f(x, y, e) (®* + y* + then = 0. 

a®* ay* a®* 

3. Find y', y", y"', if ®» + y» — 3o®y = 0. 

. _ , a* a* a*« 

4. Find-r-. -z-K 


a®- ay' a®*' eT^ if ** - y* + «* 


1 . 


6 . Find if 
dx 

(а) xz^ — 2 /;?® + xj/% — 5 

(б) X 2 ;» — + 3xy = 0. 


0 ; 


33. Change of Variables. In a great variety of problems in 
analysis it is required to express the derivatives of a given func¬ 
tion of one set of variables in terms of another set of variables. 
Some of the simpler problems of this sort were discussed in Secs. 
24 and 25. This section contains a formal treatment of several 
of the more diflBlcult of such problems. The question of the 
existence of solutions of the equations to be considered in this 
section will be left open until Chap. XII, where the problem 
of the differentiation of implicit functions will be reexamined 
in the light of the existence theorems established there. 

The sole purpose of the present section is to develop manipula¬ 
tive skill in calculating the derivatives of implicit functions and 
to indicate the formal modes of attack on the problem. The 
continuity of the functions and their partial derivatives is 
assumed throughout this section and will not be referred to again. 
Let 

(33-1) w = /(u, v) 

denote a function of two independent variables u and v, and 
suppose that u and v are connected with some other variables 
« and y by means of the relations 
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(33-2) 


x x(u, v), 

y 


If the equations (33-2) are solved for x and y to yield 


(33-3) 


(u^ u{x, y)y 

= v(xy y)y 


and the expressions (33-3) are substituted in (33-1) for u and 
Vy there will result a function of x and y, say, 


(33-4) 


'w = F(Xy y). 


The partial derivatives of w with respect to x and y can be 
calculated from (33-4) directly, but frequently it is impracticable 
to effect the solution (33-3), and it is desirable to consider an 
indirect mode of calculation. By the rule for the differentiation 
of composite functions, 


(33-6) 


dm dw dx . dm dy 
dx du'^ dy du 
dw _ dw dx , dw ^ 
dv dx dv dy dv 


The partial derivatives —j 


—j and can be calculated 


dx dy dx j dy 
du dv dv 

from (33-2), and hence they may be regarded as known functions 
of u and v. The partial derivatives in the left-hand members 
of (33-5) are also known functions of u and v since they can be 
calculated from (33-1). 

Hence, equations (33-5) may be regarded as linear equations 


for the determination of ^ and 

dx dy 


Assuming that 


j(«,») s 


dx 


du 

du 

dx 


dv 

dv 


^ 0 , 


and solving by Cramer’s rule pves 



dw 



du 

du 


dw 

dy 

dw _ 

dv 

dv 

dx 

J(u 

, v) 


dx 

dw 

du 

du 

dx 

dw 

dv 

dv 


J {u, v) 


dw 
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The resulting expressions for — and ^ are known functions 

ox ay 

of u and v and thus can be treated exactly like (33-1) if it is 
desirable to calculate the derivatives of higher orders. 

As an example, consider the function i^(r, 6), and let it be 
required to calculate the partial derivatives of w with respect to 
X and y, where x = r co8 6 and y = r sin 6, Now 


dw 

Hr 

dw 

He 


dw dx . dw dy 
dx dr dy dr 
dw^ dw dy 
'^dd'^dydS 


dw i ew . ^ 

cos ^ + “T- siJi ^3 

dy ^ 


dx 


dw 

H^ 


• n I 

Sin e + —r cos 6. 
dy 


Solving these equations for and in terms of ^ and 


gives 


dw 

Hx 

dw 

dy 


dx 


= COS B-t - 

dr 

= sin^- + 


dy 

sin B dw 
r dB' 
cos B dw 
r dB^ 


The function J is, in this case. 


dr 


dB. 


cos B sin ^ 

—r sm r cos ^ 


which does not vanish unless r = 0. 

As a somewhat more complicated instance of implicit differ¬ 
entiation, consider a pair of equations 


(33-6) 


’F{x, y, M, v) = 0, 
Gix, y, u, v) = 0, 


and let it be supposed that they can be solved for u and v in 
terms of x and y to yield 


(33-7) 


u = uix, y), 
V = v(x, y). 


The partial derivatives of u and t» with respect to x and y can 
be obtained in the following manner. Considering x and y as 
the independent variables and differentiating equations (33-6) 
with respect to x and y gives 
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(33-8) 

dx ^ dudx dv dx ’ 

^,§E_du dFdl 
dy ^ dudy~' dv dy 

= 0; 

dG , dG du , dG dv _ 

dx ^ du dx"^ dv dx ~ ’ 

dG , dGdu , dG dv 
dy dudy dv dy 

= 0. 


Equations (33-8) are linear in and 

As a consequence of the hypothesis that Eqs. (33-6) possess 
the solution (33-7), it follows that 


J (u, v) 




du 

dv 



du 

dv 


in the region for which the solution (33-7) is valid.* Accord¬ 
ingly, the partial derivatives in question can be determined from 
(33-8) by Cramer's rule. 

A special case of Eqs. (33-6) is interesting. Let 
X - fiu ,»), 

y = »)■ 

Differentiating these equations with respect to x and remembering 
that X and y are independent variables, one obtains 


(33-9) 


1 — -L 

du dx dv dx 

0 = ^ ^ 4 - 

dx dv dx 


These equations can be solved for ^ and if 

dx dx 


J (w, v) 


Example 1. Let 




du 

dv 



du 

dv 


w* — + 2a; = 0, 

uv -- y ^ 0. 

* The proof of this assertion is given in Chap. TTX. 
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Differentiating with respect tc x, 

V”"' 


Hence 


du 

dx 


du . dv ^ 


u ^ 

dx 


dx M* + »*' 

Differentiating the first of these results with respect to x gives 


dht, 

dx* 


+'t»*) + 2 


/ du , dv\ 

{'‘T^+’sir 


(U^ + i;2)2 

=- ~ 2u(u^ — v^) _ u{3v^ — u^) 

(u^ + (u^ + 

One obtains similarly and higher derivatives. 

Example 2. Let 


(o) 


(x = u + V, 
\y = 3-w + 2v. 


Differentiating with respect to x, 


- du.dv 
I — —r TT”’ 

dx dx 

(,.3p + 2^ 

dx dx 


SO that 


du 

dx 


= -2, 


dv 

dx 


= 3. 


It is easily checked that 


— = 1 ^ — _i 

dy ’ dy~ 

Equations (a) can be solved for u and v in terms of x aad y, 
and the result is 

tt = —2x + y, 

» “ 3* — y. 
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Regarding u and v as the independent variables and chfferentiat- 
ing these equations ■with respect to u, one finds 

l=_2f+ a 

du du 
du du 


Hence, 


I® = 1, = 3, 

du du 


It should be noted that ^ and ^ are not reciprocals in general, 

as, of course, is obvious from (33-9). 

Example 3. Ji w ^ uv and 


ih) 


+ V + X = Oy 

— u — 2/ = 0, 


one can obtain as follows: Diifferentiation of w with respect 
to X gives 

dw dv du 
dx ^ dx ^ dx 


The values of ^ and ^ can be calculated from (6) as was done 
in Example 1. The reader will check that 


dw 

dx 


u + 


1 Hh 4uv 

PROBLEMS 


dw 2u^ — V 
dy 1 -+■ 4tuv 


1. If + 2 /* — 2a; = 0, 4- 1 ;» — a;* + Sj/ » 0, find 

dx dx dy 
and 

% 

^ , dw , du? .. u 

2. Knd — and —> if w » 

dx dy V 


\x u + V, 
i|y = 3u -f 2v. 


and 
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3. Show that if f{x, y, z) = 0, then ^ = 1 and —1. 

ox az dy oz ax 

Note that in general — and ^ are not reciprocals. 

4. If a? = a;(t4, v), y *= v), and ^ and ^ = —fr> then 

au dv ov du 

dhjo dhff / d^\r / / dxVI 

dw* dv* \da;* dy*/L\dw/ \dv/ J 

5. Show that the expressions 


and 



Fa 


dx* d/ 


upon change of variable by means of 

a; = r cos 0, 
y = r sin 

become 


and 

6* Show that 



dr* r* dd* r dr" 
< 

dW . dW 
dP ® dx*’ 


if F = f(x + ct) + g(x — ct)f where/and g are any functions possessing 
continuous second derivatives. 

7. Show that 


d*F d«F 
dx* dy* 

ifx^e'cosd, y^e^sind. 

8 . Find if 
dx 




d’V\ 

dff*/’ 


u* -V* -x* + 3y = 0, 
a + » — y* — 2a; = 0. 
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9 . Prove that 


— ^ - n 

dxdu'^dxdv ~ 


if V> «, ») = 0 and G(x, y, u, ») = 0. 

10. If Vi{x, y, z) and Vjix, y, z) satisfy the equation 


then 


v»7 = ^ + £Z + £!I = o 

dx* ^ ^ dz* 


U = Vi(x, y, z) + (x* + y* + 2 »)F,(z, y, 
satisfies the equation 



CHAPTER IV 
DEFINITE INTEGRALS 

34. Rie mann Integral. The concept of a definite integral had 
its origin in problems dealing with the determination of the area 
under a curve. Despite the fact that the refined concept of 
what is known as the Riemann integral is very far removed from 
the geometrical notions that led to its definition, it seems desirable 
to begin the study of Riemann integration by presenting a rea¬ 
sonably careful definition of the definite integral based on the 
intuitive concept of the area under the curve. An analytical 
definition of the Riemann integral is given in the next section. 



The function /(re) considered in this section is assumed to be 
continuous and single-valued. Let the interval of definition 
of the function he a ^ x S b, and assume that the graph of 
the function lies above the a;-axis. The area bounded by the 
curve y = f{x), the x-axis, and the lines z = a and x — b will 
be denoted by S (Fig. 22). Divide the interval (a, b) into t? 
parts by the points 

a S Xq, Zi, «,,•••, Zf^i, Zn s b, 

whose abscissas satisfy the inequality 

Zi < (i •= 0, 1, 2, 

99 
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and draw through these points of subdivision a set of ordinates 


yi, yt, • • • , Vn-i- 

The area S "will be divided into n vertical strips, the ith one of 
which has a base of length AZi = x,- — x<_i and an area A/S,-. 

Denote the maximum and the minimum values of the function 
y — /(®) ill the interval Axi by Mi and mi, respectively, and con¬ 
sider the rectangular areas 


Clearly, 


mi Axi and Mi Axi. 
m, Axi £ ASi ^ Mi Axi, 


so that the area /S is not less than 


(34-1) s„ = 2) m,- Azi, 

i-l 

which represents the sum of the areas of the inscribed rectangles. 
On the other hand, the area S is not greater than 


(34-2) /S„ '2^MiAxi, 

♦ "I 

which stands for the sum of the areas of the circumscribing 
rectangles. Therefore, one can write 

(34-3) Sn ^ ^ 5n. 

The difference between (34-2) and (34-1) is' 


(34-4) 8n — {Mi — rri^ Aa;,-, 

i-l 

and if the number n of subdivisions is increased indefinitely 
in such a way that all of the subintervals Axi —» 0, the difference 
Mi — m; will also tend to zero, since f{x) is continuous. It 
does not follow without proof that ;S« — will tend to zero, 
since the number of terms in the sum increases with the increase 
in n. It will be shown, however, that this is the case. 

Consider the set of numbers 

Mi — mi, (i = 1, 2, • • • , n), 

associated with some particular mode of subdivision of (a, h) into 
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n parts, and denote the greatest of these numbers by dn. Then 
the sum in (34-4) certainly will not be decreased if each Mi — mt 
is replaced by d„, so that 

n 

Sn ^ AXi = dn(J^ Ct). 

t-1 


But Sn — Sn is nonnegative, so that 


0 Sn Sn ^ dnib — a), 


and since dn —> 0 when n —> oo, it follows that 


lim (Sn - Sn) = 0, 

n--+ 00 

or 

lim Sit = lim s„. 

n—^ 00 n--> 00 


The area S, under the curve y = f{x), as is seen from (34-3), 
is intermediate to 8» and Sn, and since both s„ and Sn have the 
same limit, it is clear that their common limit is S. Thus, 

lim Sn = lim Sn — S. 

n— 4 - 00 n—> 00 


Moreover, let be any point in the interval Axi, and form the 
sum 

s'n = i;/(fi) A*.-, 


which represents the sum of the areas of rectangular strips whose 
heights are intermediate to m,- and Mi, so that 


Since 

it follows that 


Sn^^S’n:^ Sn. 
lim «„ = lim Sn = S, 

n—»■ 00 n—* 00 

lim S'n = S. 


Hence, the sum may be constructed for an arbitrary choice of 
the point in the subinterval Axi, and its limit will be the same. 
This leads to the following definition: 

Definitioii. Let fix) he a contirmous function defined in the 
interval a ^ x ^b. Let the interval (a, h) he divided into n sub- 
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intervals by inserting the points of subdivision Xi in such a way that 
a ^ Xq < X\ < XiL < * • * < < Xn^b. 

Let ii be any point in the interval of length AXi = — Xi^t. The 

limit of the sum 

as n^^ 00 in such a way that the greatest Axt —> 0, is called the 
Riemann definite integral of f{x) between the limits a and b. It is 
denoted by the symbol 





The geometrical reasoning that led to the definition of the 
integral of Riemann involved an assumption that f{x) is a non¬ 
negative function. The fact that this assumption is not an 
essential one can be seen from the following considerations. 
Assume first that/(a;) is negative throughout the interval (a, 6). 
Then each term in the sum 

i-l 

is negative, and the limit of the sum will be a negative number. 
Hence, areas lying below the aj-axis must be reckoned as negative. 

If/(a:) is not always of the same sign, denote the smallest value 
of /(») in (o, h) by —m (Fig. 23), Then the fxmction 

F(x) = fix) + m 
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is positive or zero throughout the interval (o, 6), and one can form 
the integral of F{x), namely, 

dx — + m] dx 

. n 

= lim + m\ Axi 

n It 

= lim ]^/(|<) Axi + lim V m Axi. 

n—> w n--+ « 

t —1 t"*! 

The second term in the right-hand member of this equation gives 
m(b — a), and if the integral of F{x) exists, 

It 

lim ]£/({<) AXi 

n-* 00 

t —1 

will surely exist. 

The restriction that a be less than b likewise can be removed. 
Thus, suppose that a > b, and let the interval (6, a) be sub¬ 
divided into n parts by the points such that 

a = *0 > xi > X2 > • • • > x„_i > x« s 6 . 

Then the difference 


Xi — Xi-i = Ax,- 
is negative, so that the value of theWm 

n 

Ax< 

will differ only in sign from the corresponding sum appearing in 
the definition. Hence, 

f^ix) dx = -f“fix) dx. 

In view of this relation (as well as from the geometrical inter¬ 
pretation of the definite integral), it appears sensible to say 
that 


J“f(x) dx = 0. 

It should be noted that the value of the definite integral 
J*V(*) dx is a number S which certainly does not depend on the 
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fihoice of the letter used to denote the variable of integration. 
Consequently, the letter denoting the variable of integration 
can be changed at wiU. Thus, 

The foregoing discussion was restricted to the consideration 
of continuous functions only. However, the limit of the sum, 
figuring in the definition, may exist and be independent of the 
mode of subdivision of the interval (a, h) into subintervals Axi 
(as wen as of the choice of |<), even if f{x) is not continuous.* 
Any function for which the integral of Eiemann exists is said to 
be integrabh in the sense of Riemann. 

It is left to the reader to show: 

(a) That whatever be the choice of the three numbers a, b, and c, 

dx = £f(x) dx + J^fix) dx; 

(b) That if fi(x) andf^ix) are two integrahle functions, then 

+/ 2 (»)] dx = fyi(x) dx + fyt(x) dx; 

(c) That if f{x) is an integrable function and c is any constant, 
then 

(d) That if |/(a:)| denotes the absolute value of the integrable 
function f(x), then 


I dx^ ^ £ f(x) dx, 


if a < b. 


36. Riemann Integral {Continued). The existence of the com¬ 
mon limit S of the sums Sn and Sn in Sec. 34 hinged upon the 
geometrical concept of the area bounded by the curve y = f{x), 
the ordinates x = a and x ^ b, and the x-axis. A geometrical 
argument does seem convincing enough until one begins to 
inquire carefully into the possibility of graphical representation 
of continuous functions. It was indicated above that one need 


* See Sec. 36. 
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not go very far out of his way to meet some continuous functions 
which cannot be represented graphically. The function 

f(x) = X sin -j if X 9^ Oy 

= 0, if rr = 0, 

in the vicinity of the origin is one such example. The reader may 
be inclined to disregard the seriousness of the situation since 
this function misbehaves only at one point of the interval, namely, 
where it fails to have a derivative, but it was demonstrated by 
Weierstrass that there are continuous functions that fail to have 
a derivative at any point of the interval. Such pathological 
behavior of continuous functions led to a careful inquiry into 
the meaning of such geometrical concepts as the area under a 
curve, the length of arc, the volume, etc., on which a considerable 
portion of analysis rested until the latter part of the last century. 
An offshoot of this inquiry was the theory of functions of a real 
variable, which is characterized by a complete absence of intuitive 
geometrical concepts. The exact meaning of the concept of the 
area under a curve is thus made to depend on an analytical 
definition of the definite integral, rather than the other way 
round. 

A brief outline of the analytical definition of the Riemann 
definite integral, together with the statement of some important 
theorems, is contained in this section. The treatment is neces¬ 
sarily condensed and glosses over some of the more intricate 
points, which properly must be deferred to a course in the theory 
of functions of a real variable. 

If the elements of a given set of numbers (J?), when represented 
by points on the number axis, possess the property that there 
are no points of the set (E) to the right of some fixed point, then 
the set is called hounded on the right, or bounded above. If, on 
the other hand, there are no points of the set (E) to the left of 
some fixed point, then the set (E) is hounded below, or bounded 
on the left For example, the set of positive rational numbers 
is bounded on the left but is xmbounded above. The set of 
negative rational numbers is boimded above, but not below. A 
set of real numbers between 0 and 1 is bounded above and below. 
Every set bounded above and below is said simply to be hounded. 
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If a set of numbers (E) has the following properties: 

(i) there is no number of the set (E) which is greater thin some 
number M; 

(m) there is at least one number of the set (E) which is greater 
than Jf — where e is an arbitrarily small positive number^ 
then the number M is called the upper bound of the set {E), 

On the other hand, if the set (E) possesses the properties: 
(i) that there is no number of the set smaller than some number m; 
{ii) that there is at least one number of the set (E) which is 
less than m + e, however small the positive number e may be, 
then the number m is called the lower bound of the set (E), 

If one cares to take advantage of the suggestiveness of the 
language of geometry, then the meaning of the upper and lower 
bounds of a set of numbers is the following. The points of the 
bounded set (E) aU fall in a segment of finite length, and the 
numbers m and M are the end points of the segment. It appears 
from this remark that every bounded set necessarily must have 
the upper and lower bounds. A rigorous arithmetical proof of 
this fact is based on the study of the linear continua and is not 
given here.* 

Denote the set of values assumed by the bounded function 
f(x) m (a, b) by (jB). Then the upper and lower bounds of the 
set (E) are called the upper and lower bounds of f(x) in (a, b). 
Let M and m be the upper and lower bounds of a bounded func¬ 
tion f(x) defined in the interval (a, 6), and let (xi, x^) be any 
subinterval contamed in (a, 6). Then the upper bound of f(x) in 
(xi, xs) certainly wiU not be greater than M, and the lower bound 
will not be smaller than m. Hence, if the interval (a, b) is sub¬ 
divided into n subintervals, and if the upper and the lower bounds 
of f(x) in each of the subintervals are denoted by Mi and Wf, 
respectively (i = 1, 2, • • • , n), one is assured that m 
and Mi ^ M, This fact is of basic importance ir. what follows. 

Let the interval (a, b) be divided into n subintervals by the 
points 

a ^ Xq < Xi < X% < * * * < <Xn^b, 

and form the sums 

n n 

S = — *t_i) toi 

<—1 

^ See, for example, E. W. Hobson, Theory of Fimotions of a Beal Vaiiabia 
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^ ^ mi{xi — Xi_i) s ^ mi AXi, 

t-i t-i 

The sums S and « depend on a particular mode of subdivision 
of (a, 6) into n parts, but for each particular mode of subdivision 
$ S S, since mi Mi. 

Consider the set of numbers S corresponding to all conceivable 
modes of subdivision. No matter what mode of subdivision is 
chosen, 

(35-1) S == MQ) - a), 

since Mi ^ M and ^ Axi = 6 — o. 

Similarly, 


(36-2) 

Now, since 


s = ^nii Axi S: mQ) — a). 
si^S, 


it follows from (35-1) and (35-2) that 


and 


mQ>-a) S S. MQ) - a), 
mQ) — a) ^ 8 ^ MQ) — a). 


These inequalities state that for any mode of subdivision of the 
interval (a, b) into n parts the sums S and s lie between mQ) — o) 
and MQ) — a), and therefore the sums S have the lower bound, 
say J, and the sums s have the upper bound, say I: From the 
definition of these bounds it follows that 


and 


J 

I ^ 


If each of the intervals Axi (in any particular subdivision) is 
subdivided further by inserting additional points and the new 
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sum S is formed for this larger number of subdivisions, then this 
new sum cannot be greater than the old 8, and in general it will 
be less. Moreover, the sum 8 arising from any mode of sub¬ 
division of (a, 6) will not be less than the sum 5 resulting from 
this or any other mode of subdivision. This leads one to sus¬ 
pect that when the number n of subdivisions is increased indef¬ 
initely in such a way that each Aa:*- 0, the sum 8 tends to a 

definite limit which is independent of the mode of subdividing 
(a, h) into subintervals Aa;*-, and that this limit is J. 

On the other hand, s will in general increase with the increase 
in the number of subdivisions, while remaining less than or equal 
to 8j so that it is likely that its limit is J. The correctness of 
these surmises was established for the first time in 1875 by the 
French mathematician Darboux, who enunciated the following 
theorem: 

Theorem. The sums 8 and s tend to definite limits J and J, 
respectively, when the number of intervals Aa:* increases indefinitely 
in such a way that each and every Axi 0. Moreover, I ^ J. 

The proof of this theorem is given in books on the theory of 
functions of a real variable.* The numbers J and I are called, 
respectively, the upper and lower Riemann integrals of f(x) in 

(a, by 

From the definition of the upper and lower bounds it follows 
that if (i is any value of x in the interval Aa;*, then 
Mi /({<) ^ Mi. 

Therefore, 

n n n 

^miAXi Axi ^ ^MiAXi, 

»«1 iml 

and if it should happen that 

lim V m* Axi == lim V M{ Axi, 

*L—♦ 00 » OO 

♦ ■•I t"**! 

that is, if I = J, then the sum 

Arc.- 

♦ See Hobson, E. W., The Theory of Functions of a Real Variable, vol. 1, 
3d ed., p. 462; db la ValiJb Poussin, C. J., Cours d'analyse infinit^siinale, 
vol. 1, 3d ed., p. 260. 
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will have the same limit for any choice of the points Ji. Any 
bounded function whose upper and lower integrals are equal is 
said to be integrable in the sense of Riemann, 

It will be observed that if I = J, then the difference between 
the sums S and s, 

n 

(Mi — vti) Axi, 

t»l 

must approach zero as n increases indefinitely and the Axi 0. 
This criterion enables one to show that every continuous function 
is necessarily integrable. For, if f(x) is continuous in the closed 
interval (a, 6), it is uniformly continuous there. Hence, the 
interval (a, b) can be divided into a finite number of subintervals 
Axi such that for any pair of values of x (say xi and x^) in the 
subinterval Aa;* 

- /(^ 2)1 \Mi - rrtil < €. 

Thus, 

n n 

^ {Mi - Wi) Axi < 2) € Axi = c(6 - a). 

Since eQ) — a) can be made arbitrarily small, any continuous 
function of x is integrable. 

It is not difficult to see that any function which is continuous 
except for a finite number of ordinary discontinuities is integrable 
also. The points of discontinuity can be enclosed in a finite 
number of intervals, each of which is arbitrarily small, and it 
follows from the discussion just above (and from the fact that 
the number of intervals enclosing the points of discontinuity 
is finite) that 

n 

(Mi — m<) Axi 

i-1 

can be made arbitrarily small. 

1if{x) is integrable then |/(rr)| is integrable, since, for any given 
mode of subdivision, the difference S — s for \f{x)\ is less than 
or equal to the corresponding difference >S — 5 for f{x). More¬ 
over, if fi{x) ^ f 2 {^)} fi'Ud if both/i and/a are integrable in (a, b), 
then 

^ ^ b > a. 
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Note that the difference 

^ /i(^) ““ hi^) ^ 

and that <p{x) is integrable since both fx{x) and ftix) are. Then 

da; ^ 0. 

Thus 

which proves the assertion. 

It may be remarked, in conclusion, that more general defini¬ 
tions of the integral have been given by Lebesgue, Stieltjes, 
Denjoy, and others. The object of all these definitions is to 
include a wider range of functions than those integrable in the 
sense of Riemann. One characteristic feature of all these 
definitions is that if a function satisfies the limitations imposed 
upon it in the treatment of Riemann, then the other integrals 
lead to the same value as the integral of Riemann. 

Since only Riemannian integrals are used in this book, the 
term irdegrdble function will be used henceforth to mea^xi function 
integrable in the sense of Riemann. It should be observed that 
the integrable function, as defined above, is necessarily bounded. 
Some writers include in the class of integrable functions those 
unbounded functions whose improper integrals exist. The 
subject of Improper Integrals is treated in Chap. X. 

36. Direct Evaluation of Integrals. The definition of the 
Riemann integral of f{x) can be applied to calculate the value 
of thedntegral of any integrable function, but it will be seen from 
the examples given below that the problem of evaluating an 
integral directly from the definition is likely to be quite vexing. 
In fact, one rarely uses mathematical definitions for purposes 
of calculation,* and a powerful theorem known as the fundor 
mental theorem of the integral calculus (established in Sec. 38) 
enables one to calculate easily the integrals of a large number 
of continuous functions. However, the concept of the definite 
integral as the limit of the sum is so important that it seems 

* The reader will recall that he seldom uses the definition of the derivative 
in calculating the derivatives of specific functions. Instead, he develops a 
set of formulas based on the definition. 
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desirable to apply the definition to the calculation of the integrals 
of some simple functions before the fundamental theorem is 
discussed. The reason for dignifying this theorem with the 
adjective fundamental w'ill be apparent when the same problems 
are solved with its aid. 



Consider the function 

fix) — x^, where 0 ^ a: < 1. 

Since x^ is continuous, one is assured that the limit of the sum 

n 

^fiii) exists and is independent of the choice of the and 

of the mode of subdivision of the interval (0, 1) into n parts. 
Thus, to make the problem easier, let the interval (0,1) be divided 

into n equal parts so that Axi — ~ (Fig. 24). The points of 

n 

subdivision a;o, Xi, X 2 , • • • , x.n-i, Xn are 

.12 n- 1 , 

n n « 

If the points be chosen as the right end points of the intervals 
Axi = Xi — Xi^i, there results 
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n 

dx = lim V/(fi) AXi 

•/O n-->w 

„_,«Ln* n \n/ n 


+ 


+ 


lim 


12 + 2 * + + 


+ n* 


(tLziVi + p.ll 

\ n /n nj 


71* 


Now the sum of the terms in the numerator is given by the 
formula* 


V + 2^ + 3^ + 


I + l)(2n + 1) 

n — n 


Substituting this in the right-hand member of the foregoing 
expression gives 


f & = Urn + + 

Jo 6n* 


1 

3' 


The reader ■will find it instructive to carry out the calculation 
in this example by choosing Axi = - and — (i — di) Axi, 

7t 

where 0 ::S ^ 1, (i == 1, 2, • • - , n). The 0i need not be 

equal. Of course, the limit should be the same for an arbitrary 
choice of the points 

Another example of a direct calculation of the integral may 
prove instructive. Let it be required to evaluate the integral 

If the interval (0, z) is divided into n equal parts, so that 


Azi = Zi — Xi^i ^ ^ m hj 

u 

* The reader will have no difficulty in proving this assertion by mathe¬ 
matical induction. 
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and if & is chosen to be equal to Xi-i (Fig. 25), then 




n 


= Ax.- 

♦ •■I 

= ^[1+ e* e** H- • • • + 


Calculating the sum of the n terms of the geometrical progression 
appearing in the bracket gives 



= (e* - 1) 


e* — 1 



^ce nh 


gives 


X. Letting h—^0 and noting that 
h 


lim -r 


= 1 


dx = e® — 1- 
PROBLEM 




Evaluate directly from the definition 


X dx. 


37. Mean-value Theorems for Integrals. 

Theorem 1 (First Mean-value Theorem for Integrals). Let 

/(x) and ^(x) 6c two functions which are continuous in the interval 
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(o, h) and suppose that <p(x) does not change sign in this intenal. 
Then there exists at least one value where a ^ ^ S b, such that 

J‘y{x)<p{x) dx = fWf^<p(x) dx. 

In order to prove this theorem, consider 

- f(x)]<pix) dx, 

in which M stands for the maximum value of f(x) in (a, b). 
Let it be supposed that <pix) ^ 0; then, since M ^ f{x), it follows 
that* 

J\m - f(x)]<p(x) dx ^ 0 , 

or that 

(37-1) Mj^vix) dx ^ jy(_x)<p(x) dx. 

Similarly, if m represents the minimum value of f(x) in (a, b), 
it is seen that 

(37-2) ^ mj\{x) dx. 

It follows from (37-1) and (37-2) that 

jy(x)<p(x) dx = ix£ <p(x) dx, 

in which m ^ M ^ ikf. But f(x) is continuous and hence there 
exists some value f between a and b, for which/({) = There¬ 
fore 

(37-3) jy(x)<pix) dx = f{^)£<p{x) dx. 

In case <p(x) = 1, (37-3) reduces to 

£f{,x) dx = /({)(6 - a), 

a form which is already familiar from elementary calculus. 

This first mean-value theorem expresses the integral in terms of 
the value of one of the functions at a point intermediate between 

♦ E 0, it is m^ly necessary to reverse the inequaKties. 
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a and 6. Another mean-value theorem for integrals uses the 
intermediate value in the limits. This second theorem requires 
the definition of functions which are monotone increasing or 
monotone decreasing. A function <p(x) is said to be monotone 
increasing in the interval {a, b), if (p(x 2 ) ^ <p(xi) for X 2 > Xi, for 
all values of X\ and Xi in (a, 6). It is said to be monotone decrease 
ing, if (p{x^ ^ for x^ > Xi, for all values of Xi and Xz in (a, 6). 

Theorem 2 (Second Mean-value Theorem for Integrals). Let 
f(x) and <p{x) be two functions which are continuous in (a, 6). 
If (fix) is a positive monotone-decreasing functionj then there exists 
a value where a ^ ^ ^ b, such that 

dx = p(a)J^f(x) dx. 

If <p(x) is a positive monotone-increasing function in (a, b), then 
there exists a value f, where a < ^ < b, such that 

Lf{x)<p{x) dx = <p(b)£six) dx. 

If <p(x) is either monotone increasing or monotone decreasing but not 
necessarily always positive, then 

£f{x)<p{x) dx = <p(a)jy(x) dx + <p{h)ff(x) dx. 

The proof of the first part of the theorem depends upon the 
fact that 

n 

dx - Xi-i), Xi-i ^ ^ Xi, 

* —1 

in which the interval (a, b) has been divided into n parts by the 
points Xi in such a way that 

a = Xo < Xl < Xz •• • < Xn^l < Xn = b. 

Now consider the expressions 

r 

Xi^i), r = 1, 2, • * * J n, 

<-i 

and let M represent the largest and m represent the smallest of 
these expressions. Then, since 

/(5i)(xi - Si 

^j—i) = S/ S/—1, J ~ 2, 3j * • • , Uf 


and 
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it follows that 


~ *»-l) = + 2)<»(?<)(«>• “■ «<-!) 

»-l »-2 

n —1 

(37-4) -f 

But <p(_x) is a positive monotone-decreasiag function, so that each 
expression <p(ii) — <p(^i+i) is nonnegative, as is Hence the 

right-hand menaber of (37-4) is not less than 

«-i 

]^to[¥>(Sj) — <p(€i+l)l + Wl<£>(fn) = mifi(ii), 

»■» 1 

and it is not greater than 

n-l 

^M[<p(^i) — ^(ft+l)] + M<p(^n) = M<p{^x). 

Therefore, 


As n is increased so that each of the differences Xi — 
approaches zero, fi approaches a. Moreover, since m and M are 
the smallest and greatest of the expressions 

Sr = 5^(fc)(a^ - 
»«1 

it is seen that, as n is increased, m and M approach, respectively, 
the minimum and maximum values m and M of dx, where 

7) takes aU values from a to 6. Hence, 

m<p(a) ^ J^^p(x)f(x) dx S M*p{a) 
and 

J[ <p(x)^(x) dx = tKp(a), 

in which m ^ ^ M. But /(«) is continuous and therefore* 

*SeeSec. 38. 
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there must be some value | for which dx. It follows 

that 

(37-5) J^<p(x)f(x) dx = <p(a)J^f(jc) dx, a ^ ^ b. 

Similarly, if <p(x) is a positive monotone-increasing function, 
it can be shown that 

(37-6) J^<p(x)f(x) dx = vib)j‘^f(x) dx, a ^ ^ < b. 

For the third part of the proof, suppose that <p(x) is a mono¬ 
tone-increasing function. Then define $(x) by 

Hx) = <pib) - <p{x) 

so that #(x) is a positive monotone-decreasing function in (a, b). 
Hence, 

jy(x)^(x) dx = $(a)J^^/(a:) dx 

= [v>(h) - «?(«)] (,V(*) dx- 


But 


fy(x)Hx) dx = fy(.x)[<pQ)) - vix)] dx 

= <p(b)jy{x) dx - £fix)(p{x) dx. 

Hence, 

£K^)<p{^) dx = dx — <p(Jb)J^f{x) dx + <p{a)J^f{x) dx, 


or 

£f(.x)v(x) dx = <p{b)£f(x) dx -b <p{a)£f{x) dx. 

The same result can be obtained in the case where ip{x) is a 
monotone-decreasing function by the use of the auxiliary function 

^(a:) = <p{x) - ipQ)). 

As an example of the application of the first mean-value 
theorem for integrals, consider the problem of establishing the 
bounds for the elliptic integral 

dx 

Jo V(1 - - **x*) 


where fc* < 1. 
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It follows from the foregoing that 
dx 


f- 

Jo 


•\/(l — a;*)(l — fc***) 
where 0 ^ ^ But 

'ii dx 

0 Vl “ 


Vi - , 


dx 

Jo Vl — ®* 


X 


= sin" 


1C 

6 


Hence, 


XV 


dx 


a:^)(l-jfcV) 6Vl-ifc*f* 


Replacing { by zero and one-half gives a lower and an upper 
bound for the value of the elliptic integral. Thus, 


x: 


dx 




V(1 - x^)il - JfcV) 6 Vl -V* 


38^ Fundamental Theorem of the Integral Calculus. Consider 
an integrable function f(x) defined in the interval a ^ x ^ b. 
It is clear that if a: is any point of the interval, then 


fjm dx 


exists, and its magnitude depends on the value assigned to the 
upper limit. Thus, for a fixed lower limit, the definite integral 
is a fimction of the upper limit, and it will be designated by F(x), 
so that 


F{x) = dx. 

In order to avoid confusion between the letter x denoting the 
variable of integration and the same letter used to denote the 
upper limit, the integral will be written as 

- Fix) = pit) dt. 

Let a; -f A be some point of the interval (a, b), then 

Fix + h)=^ fpM dt, 
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and 


F(x + h)- F(x) - dt - M 

- f ■"*/«) n + j°m dt. 

Combining the integrals in the right-hand member of this expres¬ 
sion gives 

(38-1) F(x + h)- Fix) = dt. 

An important deduction can be drawn immediately from (38-1). 
Since 


it follows that 



= 0 , 


lim [Fix + h) — Fix)] 0 

A->0 

$0 that F(x) is a continuous function whenever f{x) is an integrable 
function. Furthermore, if fix) is a continuous function in the 
closed interval (o, h), then the application to (38-1) of the first 
mean-value theorem for integrals gives 

F(x + h)-Fix) -mh, 

where J lies between x and x + h. 

Then 


(38-2) 


^ = ^^ F(x + A) -F(x) 
dx h-to 


= lim/(^) = fix). 


Now any function F(x) whose derivative is equal to f(x) is 
called a primitive of fix), or an indefinite integral of fix). Thus 
the statement embodied in (38-2) gives an important theorem. 

Theorem. The definite integral, regarded as a function of the 
upper limit, is a primitive of the integrand whenever the latter is a 
continuous function. 

If G{x) is any primitive of fix), then it differs from Fix) at 
most by a constant, since the derivatives of Gix) and Fix) are 
equal.* 

* See Sec. 20, p- 63. 
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Thus 

Qix) = Fix) + C, 
or 

Oix) = 

Setting the upper liinit of the integral equal to a gives 

Gia) = C, 

since dx — 0. 

Consequently, 

(38-3) ~ 

where G{x) is any primitive. 

Equation (38-3) is the symbolic statement of the following 
theorem: 

Fundamental Theorem of Integral Calculus. 7/ /(*) is con¬ 
tinuous in the interval a ^ x and Gix) is a function such 
dG 

that ^ = f(x) for all values of x in this interval, then 
£fix) dx = G{h) - Gia). 

In the first example of Sec. 36 it was shown directly from 
the definition of the definite integral as the limit of the sum that 

£x^ dx = K- 

Since a primitive of a:* is it follows from the fundamental 
theorem that 


= 1 . 



which agrees with the result obtained in Sec. 36 by a different 
method. 
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The symbol J f{x) dx is used to denote an indefinite integral 

of fix). The reader will deduce the following properties of 
indefinite integrals: 

(a) dj’fix) dx = fix) dx; 

(b) Jcfix) dx = 

(c) fUiix) +/ 2 (a:)] dx = Jfiix) dx + jf^ix) dx. 

39. Differentiation under the Integral Sign. Consider the 
definite integral 

(39-1) £^"V(x;«)dx, 

in which the integrand is a function of a parameter a (as well as 
of x) and the limits are also functions of a. This integral is a 
function of a, and not of the variable of integration x. It 
is frequently desired to obtain the derivative of (39-1) with 
respect to a in cases in which it is inconvenient or impossible to 
express the indefinite integral in explicit form. For this reason 
the following theorem is of great value. 

Theorem. Let 


cjfix) dx, where c is a constant; 


where Uo and Ui are differentiable functions in a closed interval {m, 
ai); f{x, a) and fa{x, a) are continuous in the region ^ a S at, 
t4o(«) X ^ Then 


dip 

da 


dfjx, a) 

Uo(ac) ^OL 


dx — /(wo, a) ^“"1” /(^ii 


In order to prove this theorem, first form 
A<p = ipia + Aa) — ^(a). 

Then 


=+XIw 
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The first integral of the first expression has been written as the 
sum of the first three integrals of the second expression. If the 
second and fourth integrals are combined, one can W'rite 

a + A«) — fix, a) ^ _ f 

t4o(a) 


A<p 

Act 


/■ 


f“"“' 

J t*o(a) 

J »ui 

tn(« 


Act 


dz 


« + Aa) 


dx. 


(a) Aa 

By the mean-value theorem of the differential calculus* 
f{x, a -f Aa) — f(x, a) = Aa ■ fdx, i?), a < rj < a + Aa. 
Also, by the first mean-value theorem for integrals, 

Ju.(a) Aa Aa 


Act 

' fiio, CL 4- Aa) 


Uo(a Aa) — t4o(a) 
Aa ^ ^ 


where Uo(a) fo ^ Wo(c^ + Aa); and, similarly, 


rui(i 

J <*!(«; 


t*i(a+Aa) 


f(x, a -f Aa) , _ 


Aa 


dx = /({„ a + 


where Ui(a) ^ ui(a + Aa). 
Therefore, 




with 


Hence 


a < ri < a + Aa, Uo{a) ^ fo ^ Wo(ct + Aa), 
Wi(a) ^ fi Ui{a + ^o^)* 


In case the limits Wo(a) and «i(a) are constants, say xo and Xi, 
(39-2) reduces to 

t - s[/>. “) 

* See Sec. 20. 
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Example 1. Formula (39-3) is frequently used for evaluating 
definite integrals.* Thus, if 

<»(«) = log (1 -|- a cos x) dx, 

then 

- X - ;X'(‘ “ r+icoBx ) *= 

= 1 L+ J _ sin -1 

“\ Vl — a* l-facosa;)L 


Therefore, 


= 14 + - J_ sin -1 

“\ Vl — a* 1-f a COS a;y|o 

>1 ^ - sin-1 

al Vl ““ cc\ 1 — a 1 

= Uir + \ =I - ^ 

a\ V1 - 0:7 a aVl - a® 

» 

«>(«)=*■ r 

J V“ a\/l - aV 

= ,r(log « + log -VJ- + , 


a-I-1X1 

1+aJ 


<p(a) = IT log (1 -f- 
But, when a = 0, 


a®) -f- c. 


Hence, 


v(0) = jj log 1 da: = 0. 

0 = T log 2 -f c and c — —v log 2, 

,.(»)-r log 




Example 2. Find 


if <p(a) = J 


2a 

e “• dx. 


C^2x^ -- 

-^e “'dx- e-“'{-2a) + e-*(2) 

r^2a:® -- 

I dx -f- 2ae-“* -|- 2e-*. 


* See also Sec. 97. 
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PROBLEMS 

1. Find ~t if <p(a) = [ (1 — a cos xy dx. 

da Jo 

2. Find if ip{d) = ( tan“^ dx. 

da Jo a* 

3. Find ~i if ip{a) = ( tan (x - a) dx. 

da Jo 

4u Find if ^(x I V® dx. 
dx Jo 

5. Differentiate under the sign and thus evaluate 


What is the permissible range of values of a? 

6. Differentiate under the si^ and thus evaluate 

^ (a — cos x)""^ dx by using (a — cos x)“^ dx «= ir(a^ — 1)~^, a® > 1. 


7. Show that 


log (1 — 2a cos X + a®) dx « 0, 


if a* 1, 


= IT log a*, if a* 1. 


8. Verify that 


1 r* 

ifcj ^ — «) da 


is a solution of the differential equation 


g+i-»-/(.), 


where A; is a constant. 


40. Change of Variable. In performing the evaluation of the 
definite integral with the aid of the fundamental theorem, it is 
frequently desirable to change the variable of integration in the 

integral ^ /(x) dx by means of some relation x — vit). In order to 
emphasize the need of caution, observe the following example of a 
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purely formal change of variable which leads to a nonsensical 
result. 

The integral 



Now, let it be supposed that the variable x is replaced by another 
variable t connected with x by means of the relation 

t = a:®. 

The limit in the resulting integral, corresponding to a: = — 1, is 

t = (-1)* = 1 
and the upper limit becomes 

t = (1)* = 1. 

Thus, in the transformed integral the upper and lower limits are 
each equal to unity, so that the value of the transformed integral 
appears to be zero. The difficulty here lies in the fact that the 
function x = <p{t) is not a single-valued function. 

Theorem. Letf(x) be a continuous and single-valued function of 
X in the dosed interval (a, b) and let x = (p(t) be a continuous, 
single-valued function of t possessing a continuous derivative in 
the closed interval {a, 0), where <p{ol) = a and ip{0) = b. Then 

£f(x) dx = dt. 

In order to prove this theorem, consider the integrals 

(40-1) Fix) = f^i^) ^ == £^f[vit)]<p'it) dt. 

By hypothesis x = (pit), so that Fix) is a function of t whose 
derivative with respect to f is 

dFjx) dFjx) dx 

dt dx dt 


But — fi^)> since fix) is continuous, so that 

^(=fix)p'it)=f[<pit)]<p’it), where ^'(0 


dt' 
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On the other hand, the derivatiye of ^(0 is 


HI 


=/[^( 0 ]^'( 0 . 

since the integrand of $ is continuous.* 

The derivatives of F and $ with respect to t being equal, the 
functions F and # can differ only by a constant. But for t = a, 
X = f>{oL) = d, so that 

F{x)t^ = F{a) 0. 

Moreover, 

#(a) = 0. 

Thus the functions F{x) and #(0 are equal for t = a, and conse¬ 
quently, they are equal for all values of t in the interval {a, /3). 
Setting t = ^ in the second of the integrals (40-1) and 

* = <p(0) = b 

in the first integral gives the desired result 

f^ix) dx = f^%(t)W(t) dt. 

Example. Consider dx. If x = sin t, then 

dx = cos t dt. 

It 

When a; = 0,== 0 and when x = 1, ^ so that 

** 

— x^dx = j^y/^ ~ sin* t COB tdt 

IT 

= f COS* tdt — " 

Jo 4 

PROBLEM 

Justify the substitution dx = <p'{t) dt in the indefinite integral 
//(.) dx to obtain the indefinite integral fflvitWit) dt. 

41. Applications of Definite Integrals. The reader is familiar 
with the derivation of the formulas for areas bounded by curves, 
* See Theorems 1 and 2, Sec. 12. 
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for volumes and surfaces of revolution, and fox the length of arc 
of a curve. These formulas are given below for reference, and 
in the light of the meaning of the definite integral stated in Sec. 
35, it is best to regard them as the definitions of the geometrical 
entities under consideration. 

The outline of the procedure employed in defining the length 
of arc of a curve is as follows. Assume that the equation of a 
continuous curve C is given in a parametric form as 


(41-1) 


X = <pi.(t) 

y = Viit), a^t ^b. 


Let it be required to find the length of arc of C between the points 
corresponding to the values of the parameter t = a and t = b. 
Divide the interval a ^ t ^ b into n subintervals of lengths 
A<i, Ati, • • • , A<n by inserting n — 1 points of subdivision 
chosen so that 


to tl ti tn = b- 


Denote the increments of the functions in (41-1), corresponding 
to Ah, Ah, • • • , Ah, by Axi, Axz, • • • , Axn, and Ayi, Ay*, 
• • • , Ay„. 

The sum of the lengths of the chords AC< joining the consecutive 
points on the curve C which correspond to the values of the 
parameter i = <<, (z = 1, 2, • • • , n), is 


«»= + (^yiy> 

♦ -1 

where 

ACi = V {Axiy + 

If the limit of the sum Sn exists* as the number of subdivisions 
is increased indefinitely in such a way that each Ati —^ 0, then 
this limit is called the length of arc of the curve between the 
points corresponding to the values of the parameter t ^ a 
and ^ = 6. 

To ensure the existence of this limit, it is not sufficient to 
require merely that and (p 2 (f) be continuous. It is sufficient, 
however, to assume the continuity of the derivatives of <pi{t) 

* Of course, this limit must be independent of the mode of subdivision. 
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Sil 


and ipt{t) in the interval (a, h). In this event the length s of 
the curve is given by the formula 

- PSF®'* 

The volume of the solid of revolution which is generated by 
revolving a continuous curve y — f(x) about the a;-axis, and 
which is bounded by the planes x = xi and x = xa can be calcu¬ 
lated from 

7 = f\y^dx. 

Jxx 

The surface of revolution of the same solid is 

^ +(e)’ 

In the case of the surface of revolution it is sufficient to demand 
the continuity of the derivative of y = /(x), so that the integrand 
will be a continuous function. 

Example 1. Consider the problem of determining the length 
of arc of the logarithmic spiral whose equation is 

p = 

The element of arc length in polar coordinates is given by 

ds ^ -y/{dpY + (p dey, 

so that 


fi = 71^ + ldB 

y/n^ + 1, 


= a- 


- 1 ). 


Example 2. Find the length of the lemniscate cos 26, 

Now p = a \/cos 2$, and therefore, 

iE g sin 26 
y /cos 26 
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Hence, 




sin^ 26 
cos 2B 


+ cos 20 do 


'4 do 
0 \/cos 20 


Setting 20 ^ X gives 


\/cos X 


and the substitution of cos <p = \/cos x gives 


Jo V1 ~ H sin^ <p 

This integral cannot be evaluated in a closed form with the 
aid of the elementary functions. It is the standard form of the 
elliptic integral of the first kind, which can be evaluated either 
in infinite series (see Sec. 86) or with the aid of the tables of 
elliptic integrals. 

PROBLEMS 

1. Find the area bounded by the curve 

2. Find the volume generated by revolving the curve + ^/^ = 
about the x-axis. 

3. Find the surface of the solid whose volume is required in Prob. 2. 

4. Find the surface of the ellipsoid of revolution 

x^ + y^ 

Ans, S = sin*"^ e + 2Trac^ if c > a; 

^ 7ra®(l — e*) , 1 + e , ^ ^ 

S —log --h 27ro*, if c < a; 

where e is the eccentricity. 

6. Find the surface generated by revolving the cardioid 


2a cos* 


about the polar axis. 


Ana, 
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42. Double Integrals. The definition of the double integral 
is entirely analogous to that given earlier for the simple integral. 

Let /(x, y) be a single-valued bounded function in a closed 
region 12 (Fig. 26). Let the region 12 be subdivided in any manner 
into n subregions ARi, ARa, • • • , Al2„ of areas AAi, AAi, • ■ • , 



AA,. The upper and lower bounds of the function/(x, y) in the 
subregion AR.- will be denoted by Mi and mj, respectively. 
Then 

mi AAi ^ /(fi, iji) AAi ^ JIfi AAi, 

where ((i, vi) is any point in the region ABi. Let«» and S„ denote 
the sums 



which clearly depend on the number n of subregions and on the 
mode of subdividing the region 12 into parts. 

If the sums a, and approach the same limit S when the 
number of subregions is increased indefinitely in such a way that 
each AAi -♦ 0, then the limit of the sum 

n 

^ m ni) AA{ 

i-1 
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will also be /S, since 

mi AAi m) AAi ^ '^MiAAi, 

i «-1 < -1 i *« 1 

for any mode of subdivision and for any choice of the points 
(?i, Vf)- This common limit S is defined as the double integral 
of J{x, y) over the region R, and one writes 

n 

(42-1) lim y) 

n—► «o 

t —1 

The region R is called the region of integration and corresponds 
to the interval of integration (a, 6) in the case of the simple 
integral. The term double integral refers to the dimensionality 
of the region E. 

The existence of the unique limit S is guaranteed if one 
assumes that the function /(x, y) is continuous in the closed 
region E. This is obvious from the geometrical considerations 
of Sec. 44 if one assumes that the function z = /(x, y) is repre¬ 
sented by a surface. The analytical proof makes use of the 
property of the uniform continuity of continuous functions 
/(x, y) defined over a closed region E and is not given here.* 

PROBLEM 

Let M and m be the maximum and the minimum values, respectively, 
of the continuous single-valued function/(x, y) defined over a region E; 
then 

n n n 

[gm AA.- AA< AAi. 

i-1 t-1 i —1 

Show, from a consideration of this inequality, that 

y)dA= /({, ij)A, 

where (£, »j) is some point of the region B, whose area is A. This is 
the mean-value theorem for double integrals. 

43. Evaluation of the Double Integral. It will be assumed in 
this section that the function /(x, y) is continuous over a closed 
region R, so that the limit of the siun (42-1) will be independent 
* See the analogous discussion in Sec. 35. 
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of the mode of dividing the region R into the subregions ARi 
and also of the choice of the point (Ji, within the subregion 
ARi. 

The definition given in the preceding section gives no con¬ 
venient means for the evaluation of double integrals. In order 
to evaluate the double integral, it will be simpler to consider first 

y=d 
ym-f 

yj 

yj-i 


yz 

% 

x^a Xi Xg Xi,j xi Xn-j 

Fig. 27. 

the case in which the region R (Fig. 27) is a rectangle bounded 
by the lines x = a, x = b, y = c, y = d. The extension to 
other types of regions will be indicated later. Subdivide R 
into mn rectangles by drawing the lines x = Xi, z = Xt, • • • , 
X = y = Vi, y = yt, • ■ ' , y = y^-i. Define 

Axi = Xi — Xi-i, 

where Xd = a and Xn = b, and define 

Ay/ s yj - 

where yo = c and y* = d. Let ARi,- be the rectangle bounded by 
the lines x = Xi-i, x = Xi,y — y/_i, y = y^. Denote the area of 
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the rectangle which stands in the ith column and the jth 
row, by 

A.A.ij = Axi Ayj 

and form the sum of the expressions 

Vi]) 

where (Jtj, rjij) is any point of ARij, This sum is 

(43-1) X 

»“n, 

where the summation symbol ^ signifies that the terms 

appearing under the summation sign can be added in any 
manner whatsoever. 

Suppose that the terms of (43-1) are arranged so that the 
rectangles are used first; then all the rectangles ARi^) 

then all the rectangles ARiz] etc. This is equivalent to taking 
the sum of the terms corresponding to the first, second, third, 
etc., rows of rectangles and then adding these sums. Such a 
rearrangement of the terms of the sum permits one to write 
(43-1) as the double sum 

m n 

(43-2) ^ A2/,[ ]g/(f.7, ■na) Aa;. J> 

7-1 »-l 

where the expression in the bracket represents the sum of the 
terms corresponding to any fixed value of j. From the definition 
of the ordinary definite integral, the expression appearing in the 
bracket approaches a limit when » —> <» in such a way that each 
AXi —> 0. Hence, one can write 

n ^ 

1^ %■) ^ = X 

i pa 1 

n ^ 

Vii) Ax* = Vi) dx "f" €f, 

t-1 

where lim ^ == 0. The latter expression results from the 


or 

(43-3) 
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definition of the limit, and it merely states that for a sufficiently 
large n the difference between the sum and the integral can be 
made as small as desired. 

Now the integral 

jj{x, 11 ,) dx 

contains as a parameter and hence defines a function of njjj 
say 

(43-4) vivi) = 

Substituting from (43-3) in (43-2) and making use of (43-4) gives 

m n m 

(43-5) 2) = X + */]• 

i-1 »-l i-l 

But 

lim Ay,- = £ <p(y) dy 

SO that 

^<p(rij) Ay,- = £ <o(y) dy + e, 

j-i 

where lim € = 0. Thus (43-5) becomes 

m 

% Ay,-[ ^/(ftf, va) Ax.-] = f%(.y) dy + Ay/ + «. 

f mm 1 imml ^ j mt 1 

Calculating the limit as both m and h tend to infinity gives* 

m 

* The reason for the vanishing of lim ^6/ Ay/ is not entirely obvious. 

/«! 
n—> oo J 

Even though €/—> 0 when the index m likewise tends to infinity, 

and it is conceivable that the limit of the sum may be different from zero. 
The fact that this is not the case here can be seen from the following con- 

/•iW 

siderations. Let I /(x, %•) dx denote the integral of the function /(x, w) 
over the interval Ax/. Then 

/(x, r\i) dx — /(If/, ita) Ax*| ^ jlfi/ — m</j Axi, 

where Mu and m *7 stand for the maximum and minimum values of the 
function /(x, mf) in the interval (x<_i, Xi). But 
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m n 

^ X ^y^\_ »?«) = f^v(y) dy 


m- 
n-^ 00 


where the second step is obtained by recalling the definition 
(43-4). The left-hand member of this equation gives the double 


integral v) dA, so that 

y'^ y^ ^y- 


The double integral is, therefore, evaluated by considering 
j{x, y) as a function of x alone but containing 2 / as a parameter. 


n 

2i: f(x, rij) dx ^ fix, Vi) dx. 




Hence, 


^ n n 

r /(*, rii) dx - na) A®.- ^ - mi,| A*,- 


Let e' be the largest of the numbers (t = 1, 2, 

(j = 1, 2, • • • , w), then 




Thus 


Mi, 




— mii\ Axi c' 2/ 


e'(6 - a). 


W, Vi) dx - va) Ax< 


i«l 


e'(h - o). 


But, from (43-3), the left-hand member of this expression is precisely the 
numerical value of e/, that is, 

I*,I ^ *'(6 - a). 

Hence, 


Ay,-| ^ «'(6 - a) ^ Ayj 

jml J- 


€'(6 - a)(c - d). 


Since fix, y) is a continuous function, the difference between the maximum 
and the minimum values of the function in any subregion ARa tends to zero 
as the number of subregions is increased indefinitely, and consequently* 
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and integrating it between x — a and x = b and then integrating 
the resulting function of y between y = c and y = d. The right- 
hand member of (43-6) is known as an iterated integral, and 
(43-6) establishes the relation between the double integral over 
the rectangle B and an iterated integral over the same rectangle. 

Similarly, by taking the sum of the terms in each column and 
Y 1 then adding these sums, there results 




Ax k In case (43-7) is used, /(x, y) is first 

-^ considered as a function of y alone 

_ and integrated between y = e and 
y = d, and then the resulting func- 
tion of X is integrated between x = a 
and X = h. Either (43-6) or (43-7) can be used, but one of them 
is frequently simpler in the case of a particular function/(x, y). 

Suppose R is not a rectangle but is a region bounded by a 
closed curve C (Fig. 28) which is cut by any line parallel to either 
axis in at most two points. Let Bi and 3% be the points of C 
having the minimum and maximum ordinates, and let Ai and At 
be the points of C having the minimum and maximum abscissas. 
Let X = <pi(y) be the equation of BiAiBt, and x = <pt(y) be the 
equation of BiAtBt. Then, in taking the sum of the ter ms by 
rows and adding these sums, the limits for the first integration 
will be </>i{y) and <pt(y), instead of the constants a and h. The 
limits for the second integration will be and /3s, in which /8i 
is the y-coordinate of Bi and /Ss is the y-coordinate of Bt. Then 
(43-6) is replaced by 

(43-8) fjix, y) dA = y) dx dy. 

Similarly, if y = /i(x) is the equation of AiBiAt, y = fAx) is 
the equation of AiBtAt, ai is the abscissa of Ai, and as is the 
abscissa of At, (43-7) is replaced by 

(43-9) J/(x, y) dA = y) dy dx. 

In case E is a region bounded by a closed curve C which is cut 
in more than two points by some parallel to one of the axes, the 
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previous results can be applied to subregions of R whose bounda¬ 
ries satisfy the previous conditions. By adding algebraically 
the integrals over these subregions, the double integral over R 
is obtained (Fig. 29). 



Fio. 29. Fig. 30. 


Example 1. Compute the value of Ii = J^pdA where R 
is the region in the first quadrant bounded by the ellipse 

i-. + p = l (Kg. 30). 

Using (43-8) and summing first by rows, one finds 



Using (43-9) yields 



It may be remarked that the value of Ji is equal to ffA, where 
y is the ^/-coordinate of the center of gravity of this quadrant of 

the ellipse, and A is its area. Since A = 
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. _h_ 4& 

~ A nrab 3t' 


Similarly, by evaluating J 2 



a^h 


A irab Stt 


which is the a;-coordinate of the center of gravity. 

Example 2. Moment of Inertia, It will be recalled that the 
moment of inertia of a particle about an axis is the product of its 
mass by the square of its distance from the axis. If it is desired 
to find the moment of inertia of a plane region about an axis 

perpendicular to the plane of the region, 
the method of Sec. 43 can be applied, 
where /(oj, y) is the square of the dis¬ 
tance from the point {x, y) of the region 
to the axis. Then 

M dA. 

For example, let it be required to 
find the moment of inertia of the area in 
the first quadrant (Fig. 31), bounded by the parabola y* = 1 — a: 
and the coordinate axes, about an axis perpendicular to the xy- 
plane at (1, 0). The distance from any point P{x, y) to (1, 0) 
is r = 'v/(a; — 1)* + y*. Therefore, 

M == fiix-iy + y^dA. 

Evaluating this integral by means of (43-8), there results 

n l-yt 

[(a: — 1)* -f y*] dx dy 
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44. Geometric Interpretation of the Double Integral. If 

/(a;, y) is a continuous and single-valued function defined 
over the region R (Fig. 32) of the a:y-plane, then z = J{x, y) 
is the equation of a surface. Let C be the closed curve 
that is the boundary of R. Using i2 as a base, construct 
a cylinder having its elements parallel to the z-axis. This 
cylinder intersects z = /(x, 2 /) in a curve T, whose projection 



Fig. 32. 


on the a^y-plane is C. Denote by S the portion of ^ y) 

that is enclosed by F. Let R be subdivided as in Sec. 43 by the 
lines X = Xi, (i = 1, 2, • • • , n - 1), andy = (j = 1, 2, • • • , 
m — 1). ' Through each line x = x* pass a plane parallel 
to the 2/2-plane; and through each line y = 2/? P^ss a plane 
parallel to the X 2 -plane. The rectangle LRi,-, whose area is 
AAij = Axi A 2 /,*, will be the base of a rectangular prism of height 
fiiijy Vii)j whose volume is approximately equal to the volume 
enclosed between the surface and the xy-plane by the planes 
X = Xi^i, X = Xij y = 2//-1 and y = y^. Then the sum 

t"»n, j^m 

(44-1) na) Axi Ayj 

gives an approximate value for the volume V of the portion of 
the cylinder enclosed between z = f(x, y) and the xy-plane. . As 
» eo and the sum (44-1) approaches V, so that 

(44-2) V^f/(z,y)d4. 
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The integral in (44-2) can be evaluated by (43-8) in which the 
prisms are added first in the x-direction, or by (43-9) in which 
the prisms are added first in the y-direction. 

It should be noted that formulas (43-8) and (43-9) give the 
magnitude of the area of the region R if the function/(a:, y) = 1; 
for the left-hand member becomes 

which is A. The area A can be evaluated by using 

J r0t j j rctt /•/*(*) j j 



Example. Find the volume of the tetrahedron bounded by 
the plane ^ | ^ 1 coordinate planes (Mg. 33). 

Here 



2 _ 
a b/ 


If the prisms are summed first in the axiirection, they will be 
summed from a; = 0 to the line ah, whose equation is 



= 1 . 



■X 

a 



dxdy 


Therefore, 
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abc 


6 ■ 

This result was obtained by using (43-8) for the evaluation of V, 
but (43-9) could be used equally well. 

PROBLEMS 

1. Evaluate 


(a) + y^) dy dx-, 


and describe the regions of integration in (o) and (6). 

2. Verify that + 2/^) % dx “ + P^) dx dy, where the 

region 22 is a triangle formed by the lines y = 0,y — x, and a; = 1. 

3. Evaluate and describe the regions of integration for 


rx: 


•v/as—-a?* 


dy dx; 


(c) + ** + 2/“) dy dx-, 

(e) fr xy dx dy. 


4. Find the areas enclosed by the following pairs of curves: 

(a) y = X,y = x“; 

(b) y = 2 — x, y^ = 2(2 — x); 

(c) y = A — x^, y = A — 2x; 

(d) y^ = 5 — X, y = X + 1; 

(e) y = -v/o* — *2^ j/ = a:. 

6. Fmd by double integration the volume of one of the wedges cut off 
from the cylinder x* + y* = a* by the planes z ~ 0 and 2 = ». 
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6. Find the volume of the solid bounded by the paraboloid 

+ 02 — 4a; ajid plane a; ~ 5 . 

7. Find the volume of the solid bounded by the plane a: « 0, the 

surface 2 = + y* + 2, and the cylinder a;* + 2/^ — 4. 

8. Find the smaller of the areas bounded by y = 2 — a; and 
^ a;® + 2/^ = 4. 

9. Find the volume bounded by the cylinders y = a;®, y^ ~ and 
the planes z — 0 and « — 1. 

10. Find the volume of the solid bounded by the cylinders 

a ;2 + 2/2 == and — o®. 

11. Find the coordinates of the center of gravity of the area enclosed 
by 2 / = 4 — a:^ and y = 4 — 2a;. 

12. Find the moments of inertia about the a;- and 2 /-axes of the 
smaller of the areas enclosed hyy = a — x and x^ + y^ = a\ 

46. Triple Integrals. The triple integral is defined in a manner 
entirely analogous to the definition of the double integral 
The function 

fix, y, 2 ) 

is to be continuous and single-valued over the region of space R 
enclosed by the surface S. Let R be subdivided into sub- 
regions ARijk. If AViji is the volume of ARm,, the triple integral 
of f(x, y, z) over R is defined by 

♦ ■■n, i—m, k”"p 

2 ) ^ V fiiiik,yiik,iMk)AVifl, 

in a way entirely analogous to that given in Sec. 43. 

In order to evaluate the triple integral, B is considered to be 
subdivided by planes parallel to the three coordinate planes and 
the case of the rectangular parallelepiped is treated first. In this 
case 

A = Axi Ayj AZk* 


By suitably arranging the terms of the sum 

i*-n, y—m, 

2 / fiiiih Vifk} tifk) AXi Apf AZjhf 


it can be shown, as in Sec. 43, that 

( 45 - 2 ) fufi^i y> 2 *) ^ 

By other arrangements of the terms of the sum, the triple integral 
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can be expressed by means of iterated integrals in which the 
order of integration is any permutation of that given in (46-2). 

If i? is not a rectangular parallelepiped, the triple integral 
over R will be evaluated by iterated integrals in which the limits 
for the first two integrations will be functions instead of con¬ 
stants. By extending the method of Sec. 43, it is readily shown 
that 

y’ y’ ^y 

Similarly the triple integral can be evaluated by interchanging 
the order of integration in the iterated integral and suitably 
choosing the limits. 

The expression (46-3), or the similar expressions obtained by a 
different choice of the order of integration, gives the formula 
for the volume of R in case/(a:, y, z) s 1, Therefore, 



Fid. 34. 


In order to clarify the method of evaluating a triple integral 
by means of iterated integrals, consider the calculation of the 
integral of the function/(a:, y, z) over a region R, which is bounded 
by a closed surface S, Let #(a:, y, z) = 0 be the equation of S 
and denote by V the volume enclosed by S (Fig. 34). The 
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surface S will be assumed to be such that a straight line parallel 
to one of the coordinate axes, say z, cuts S in not more than two 
points. An extension to more complicated surfaces can be 
made immediately in a manner analogous to that indicated in 
Sec. 43 for double integrals. 

Construct the right cylinder which projects the surface S 
on the a; 2 /-plane. Let C be the curve along which the projecting 
cylinder is tangent to S, and let the projection of C on the 
a; 2 /-plane be the curve C' whose equation is yp{x, y) = 0. The 
curve C divides the surface 8 into two parts. Denote the equa¬ 
tion of the upper part of the surface hj z = <p 2 {x, y), and that 
of the lower part hjz — ^).* Next, divide the volume 

V into elementary volume elements AF in the following way. 
Divide the area enclosed by C', by a series of lines parallel to 
the coordinate axes, into a number of elementary areas, of which 
AAj- is typical. Using each of the elements AA/ as a base, 
erect on each element a prism that will cut 8 in AaSi and AiS 2 , 
and divide the portions of the prisms lying between iaSi and 
AS 2 by a series of planes parallel to the rcy-plane. The entire 
volume F is thus divided into elementary volumes AF. The 
element AF,-/ = AZi A A/ is outlined in Fig. 34. 

Now select a point (x, z) within each of the volume elements 
AFi/, and form the sum 

y, z) Azi] AAj. 

\ 

The limit of this sum as Azj —>• 0 defines the integral 

y’ 

The quantity withm the brackets is a function of x and y, say 
F{x, y), and the limit of the sum 


y) 

j 

as >0 is a double integral over the area bounded by C. 
If it is evaluated by the methods of Sec. 43, there results 




* Obviously z « y) and z = <px{Xt y) are the solutions of the equation 
y, «) ■■ 0 for z in terms of x and y. 
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A specific illustration may clarify this matter further. Let 
it be required to determine the volume enclosed by the ellipsoid 


- 2)^ , (2^-9)* . (z-16)* 

1 + 4 + 9- 


= 1 . 


The equations z — <ei(x, y) and z = y) are, in this case, 

» = 16 ± 3Vl — (a: — 2)* — — 9)2, 

the upper sign giving tpi and the lower giving <px. The equation 
of the curve C is that of the ellipse 

(*-2)* , (j/-9)2 , 

1 4 

so that 

■ 9 - 2Vi - (x - 2)* 

and 

= 9 + 2V1 - (x - 2)\ 

The evaluation of the integrals is 
left' as an exercise for the reader. 36- 

As another illustration, .let it be required to find the moment of 
inertia of the solid bounded by the cylinder x* -f- y* = o® 
and the planes z = 0 and z = b about the x-axis (Fig. 35). 
Assume uniform density <r. The function /(x, y, z) is the square 
of the distance of any point P (x, y, z) from the x-axis. Therefore i 



f(x, y, z) =y^ + z\ 


Hence, 

/. = j(y^ + z^)<rdV 


4<r 


Vo*-®* 


0 Jo 


X 


(y^ + a®) dzdydx 


■ *’X +1) <te 

/*a 

= -yj^ (o* + 6® — X®) Vo® — X® dx 
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*• 

r^(o* + 6* - o* sin* e) cos* 6 de 
3 Jo 

(•■ + !,.)| - ^] . :^(3a' + »■). 

PROBLEMS 


1. Evaluate: 


2. Find by triple integration: 

(а) The volume in the first octant bounded by the coordinate planes 
and the plane x + 2j/ + 3^ == 4. 

(б) The volume of one of the wedgetf cut off from the cylinder 

a;* + 2 /* = o* by the planes z ^ 0 and z - x. Am, %a*. 

(c) The volume enclosed by the cylinder a;* + y* = 1 and the 
planes « — 0 and 2 == 2 — a;. 

(d) The volume enclosed by the cylinders ^ z and »* + y* ^ a*, 

and by the plane « = 0. Am, — • 

(e) The volume enclosed by the cylinders y* + z* « a* and 

a;® 4- y* == a*. Am, ^%a^, 

(/) The volume enclosed by y* + 2af* = 4* — 8, y* + «* »= 4, and 
a; = 0. Arw. llir. 

(p) The volume in the first octant bounded by the coordinate 
planes and x + 3y + 2z = 6. 

{h) The volume enclosed by the cylinder a?* + y* = 9 and the 
planes z = 5 — a; and z = 0. 

({) The volume of the cap cut off from y* + z* = 4a; by the plane 

z = X, 

3. Find the moments of inertia about the coordinate axes of the solids 
in Prob. 2. 

4. Find the coordinates of the center of gravity of each of the volumes 
in Prob. 2. 

5. Find by triple integration the moment of inertia of the volume 
of a hemisphere about a diameter. 

6. Find the coordinates of the center of gravity of the volume of the 
solid in Prob. 5. 

7. Find by triple integration the moment of inertia of the volume of 
the cone y* + z* = o*a;* about its axis. 
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8. Find the moment of inertia of the cone in Prob. 7 about a diameter 
of its base. 

9. Find the volume in the first octant bounded by z = x + 1, x = 0^ 
y =: Oj X = 2z, and x^ + 2 /* = 4. 

10. Find the coordinates of the center of gravity of the volume 
bounded by z — 2(2 — x — y), z = 0, and if = 4 — a ;2 _ ^ 2 ^ 


46. Change of Variables in a Double Integral. Let the vari¬ 
ables X and y be connected with some other variables u and v 
by means of the relations 


(46-1) 


U = /i(a:, y), 

V y), 


where the functions entering in (46-1) are continuous and 
possess continuous first partial derivatives with respect to x 
and y in some region of the rKjz-plane. Moreover, assume that 


V=V0 



the equations (46-1) can be solved for x and y in terms of u 
and V to yield 


(46-2) 


X = »?l(w, v), 
y = <pi{u, v). 


If « and V are assigned some fixed values, say uo and »o, the 
equations 

Uo = fi(x, y), 

Vo = /*(x, y), 


determine two curves which will intersect in a point (xo, ye), 
such that 

Xo — 9 >i(uo, Vo), 
yo = ipt(uo, Vo). 



148 


ADVANCED CALCULUS 


Thus the pair of numbers (wo, vo) determines the point (a;o, ^o), 
in the xy-plme (Pig. 36). 

If u and V are assigned a sequence of constant values 

(Wl, t?i), (t/2, n), (W3, Vz), • • • , (Wn, Vn), • • , 

there will be determined a network of curves that will intersect 
in the points 

(Xi, yi), {X 2 , 2 / 2 ), (iCs, yz), • * • , {Xny yn)y * • * . 

Corresponding to any point whose rectangular coordinates are 
{xj y) there will be a pair of curves u = const, and v = const., 
which pass through this point. The totality of numbers (w, v) 
defines a curvilinear coordinate system, and the curves them¬ 
selves are called the coordinate lines. 

Thus, if 

u = 

V = tan~^ -y 
X 

the family of curves u = const, is a family of circles, whereas 
V — const, defines a family of radial lines. The curvilinear 
coordinate system, in this case, is the ordinary polar coordinate 
system (Fig. 37). 



Consider the element of area dA in the curvilinear coordinate 
system (w, v) (Fig. 38) bounded by a quadrilateral 
the boundary of which is formed by the curves 

^ y), /i(a;, y); 

^ == y), v+ dv= f 2 (x, y). 
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The positive quantities du and dv are assumed to be finite but 
may be chosen as small as desired. 

The rectangular coordinates {xi, yi) of the point Pi can 6e 
calculated from (46-2). Thus, 


= <pi{u, v), 
yi = v). 


y^ 




Along the boundary PiPj, the coordinate u does not change, so 
that the coordinates (xs, yt) of Pt are given by 

Xi = <pi(u, V + dv), 
yi = Viiu, V -b dv). 


Similarly, the coordinates of Pj and Pi are 

Xz = <p\{u -t- du, v), yz — <pi{u -f du, v); 

Xi = <pi(u -b du, V + dv), yt = <pft(u + du, v -b dv). 

It follows from the theorem of the mean that 


«2 = «5i(m, V + dv) = vi(u, t>) dv, 

Vi = <Pi{u, V + dv) = <p2{u, v) dv, 

= <f>i(u -b du, v) = <px{u, ^ du, 

yz — ViiV' + du, v) = (pz{u, v) + ^ du. 

Now the area dA of the curvilinear quadrilateral PiP*P*P» 
is approximately equal to twice the area of the rectilinear triangle 
PiPiPz, and the approximation can be made as close as desired 
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by taking du and dv sufficiently small. The area of the recti'* 
linear triangle PiPaPs is given by the determinant* 




Xi 

yi 

1 

Xi 

yi 

1 

Xz 

y» 

1 


where the plus or minus sign is chosen so as to make the area 
positive. 

Substituting the coordinates of the points Pi, P 3 , and Pj 
in the determinant gives 


<Pl 

<(>% 

11 

dtpi 

d<pi 

'^^l+^dv 

0,+^dv 

1 _ 

2I 

dv 

A-^du 


1 

\d<pi 

du 

dys 

du 


du dv. 


Since the area of the curvilinear quadrilateral is nearly equal to 
twice the area of the triangle, one can write an approximate 
relation 

(46-3) dA = ±J(u, v) dudv, 

where 

3vi 

du du 

J(u, v) s 

d^i d^t\ 

dv dv 

The determinant J has many uses in mathematics and is 
called the functional determiTuml or Jacobian, f 
Consider next the double mtegral 

fji^, y) dA, 

* The reader, not familiar with the determinantal expression for the area 
of the triangle, will have no difficulty in deducing it from elementary con¬ 
siderations of analytic geometry 
t See Chap. XII. 
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over some region R, where f(x, y) is continuous in B. This 
integral may be expressed in terms of the curvilinear coordinates 
(w, v), by substituting for x and y from (46-2) and by making use 
of (46-3). Thus, 

(46-4) jj{x, y) dA = f/{u, v)| J] du dv, 

where 

F(u, v) = v), <pi{u, »)]. 

Some question must be raised regarding the legitimacy of 
replacing the exact element of area dA by its approximation 
given by (46-3), but the exact element of area is equal to 

[| J( -f- e] du dv, 

where e —> 0 with du and dv. 

The infinitesimal « may be neglected, since in forming the limit 
of the sum 

'^{x, y) A4 = "^Fiu, »)|J| du dv + 6^F(u, v) du dv 

one can choose du and dv so small that « (and, consequently, 
the second term in the right-hand member of the foregoing 
expression) is made as small as desired.* 

Setting fix, y) in (46-4) equal to unity gives the expression 
for the area of the region R, namely, 

(46-5) = dudv. 

In evaluating the double integrals in (46-4) and (46-5) by 
means of iterated integrals, the limits for u and v must be deter¬ 
mined from a consideration of the region iS, as is shown in the 
following example: 

Example, Let it be required to find the moment of inertia of 
the area of the circle (Fig. 39) 

-f- 2/2 — aa: = 0, 

* A more elegant mode of exhibiting the relationship between the elements 
of area in cartesian and curvilinear coordinates is given in the next chapter. 
However, the demonstration given above has the advantage of directness of 
attack on the problem, even though it calls for a justification of the approxi¬ 
mation involved 
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about a diameter of the circle. It is convenient to introduce the 
polar coordinates 

X = p COB 6 

5 / = p sin e, 

BO that the equation of the circle becomes 

p = o cos 6 . 



Fio. 39. 

Calculating the determinant J gives 

cos 9 sin 9 


= P. 


BO that 
Therefore, 


—p sin ff p cos 9l 
dA = p dp d9. 


n a 000 6 

p* sin* 9 p dp d9 

£ 


a* cos* 0 sin* 6 


TO* 

64 


4 
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47. Transformation of Points. The discussion in Sec. 46 of the 
change of variables in a double integral leading to the formula 

(47-1) dA = iJj du dv, ^ 

is capable of a somewhat different interpretation. The expres¬ 
sion (47-1) represents the element of area in the curvilinear 
coordinates defined by the equations 


(47-2) 


u = fi(x, y). 


where x and y are thought to be the ordinary cartesian coordi¬ 
nates. Now the Eqs. (47-2) can be interpreted as the equations 
of transformation of points from one cartesian coordinate system 
X, y to another cartesian system u, v. 



(a) 


•Hi 



Fio. 40. 


(b) 


Consider some region B in the a^-plane (Fig. 40), and assume 
that the correspondence of points between the ti»-plane and 
the xy-plane is one to one. This means that (47-2) can be solved 
uniquely for x and y in terms of u and v to give the inverse 
transformation 


(47-3) 


x = v), 

y = <Pihi, f)- 


Corresponding to any point («, y) of the region B the equations 
(47-2) determine a pair of numbers («, »), and conversely, 
equations (47-3) determine a unique pair of numbers (x, y) for 
every point («, v) in some region B' of the M»-plane. The 
boundary C of the region B will be mapped into some curve C 
in the Mt>-plane which will enclose the region B\ The magnitudes 
of the areas of the re^ons and B' will not be equal in general. 
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The element of axea dA in the arj^-plane will be transformed into 
an element of area dA’ in the Jf»-plane, and the ratio of the 
magnitudes of these elements of area is precisely equal to the 
numerical value of the Jacobian. Therefore [see (46-5)], 

(47-4) Jjly dx = du do. 



C, and the factor |J1 introduced in the integrand of (47-4) 
takes account of the magnification of the region B produced by 
the transformation (47-2). This point of view is adopted in 
the treatment of the change of variables given in Sec. 60. 


PROBX^MS 

1. Evaluate f dy dx, where B is the region bounded by the 

Jr 

circle a;* + y* =* a^. Use polar coordinates. Am, ir(l — e"®*). 

2. Find the area outside p = a(l + cos $) and inside p = 3a cos $, 

3. Find the coordinates of the center of gravity of the area between 
p = 2 sin 0 and p = 4 sin d. 

4. Calculate the elements of area in the un-coordinate systems which 
are related to the cartesian coordinate system xy by means of the 
following equations of transformation: 

(а) X == u + a, y = V + b; 

(б) X ^ aUy y = hv; 

(c) a? == u cos a — f sin o£, y == u sin a + v cos a; 

where a, 6, and a are constants. Interpret your results geometrically. 

6. What are the regions of integration in the wv-coordinate systems of 
Prob. 4 if the region B in the xy-plane is the interior of the ellipse 


a* ^6* 


1 ? 


6. Discuss the curvilinear coordinate system defined by the relations 

X u + v^ 
y u-v; 

arid describe the region in the ut^'plane corresponding to the square 

a? = 1, a; * 2,2/ * 1, y * 2. 

7. Discuss the curvilinear coordinate system defined by the relations 
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u 

V 2xy, 

Sketch the curves u == const, and v = const. 

8i Find the area of the cardioid p = a(l + cos 6) by integrating first 
with respect to 0 and then with respect to p. Check your result by 
calculating the same area by integrating first with respect to p and then 
with respect to 9, 

9. Find by double integration the area bounded by p = 2a cos 26 by 
integrating fet with respect to 6. 

10. Find the center of gravity of one loop of the curve in Prob. 9. 

11. Find the center of gravity of the area which is bounded by one 
loop of the curve p^ == 2a^ cos 2$ and which is exterior to the circle 
p = a, 

12. Find the moment of inertia of the area in Prob. 11 about the 
polar axis. 

48. Change of Variables in a Triple Integral. Let the cartesian 
variables z, y, z be connected with the variables v, and w by 
means of the relations 

(u =- flix, y, z), 

(48-1) h = Mx, y, z), 

(w = Mx, y, z). 

Just as in the preceding section, it is assumed that the functions 
Uy Vy and w are continuous together with their fiirst partial 
derivatives in some region R of the oj^/^-space, and that Eqs. 
(48-1) can be solved for x, 2 /, and z in terms of Uy Vy and w. 

If Uy V, and w are assigned fixed values wo, vo and Wo, then 

(Uo = y, z), 

(48-2) I Vo ^Mx,y,z), 

= /s(x, y, z). 

The equations (48-2) define three surfaces, two of which intersect 
in a curve, and the third cuts the curve in a point. Thus, a 
triplet of values (uo, »o, Wo) determines a point in space, and one 
can regard the totality of numbers (u, v, w) as the curvilinear 
coordinates. The surfaces « = const., v = const., and w = const, 
are called the coordinate surfaces. 

The element of volume dV is enclosed by the three pairs of 
coordinate surfaces (Fig. 41) 

« = Mx, y, «), 0 = Mx, y, x). 


w = Mx, y, 2 ), 
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and 


M + dw = Si{x, y, 2 ), V + dv - Mx, y, z), 
w + dw = ft{x, y, z), 


■where du, dv, and dw are assumed to be positive constants. 

The calculation leading to the establishment of the formula 
corresponding to (46-3) is entirely analogous to that of Sec. 
46, and all one needs to do is to calculate the volume of a parallele¬ 
piped that is approximately equal to the element of volume 
bounded by the coordinate surfaces 

u = const., 

V = const., 
w — const., 
u + du = const., 

V + dv — const., 

and 


w + dw = const. 



Fio.41. 

If the solutions of (48-1) be denoted by 

X = V, w), 

y = vtiu, V, w), 
z = V,(u, », w), 

then the element of the volume is 

dY — jj) du dv dw, 
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d<p2 

du du 

d<pi d<pz 

dv dv 

d<P2 d<pz 

dw dw 

The Jacobian (48-3) is frequently written in the following 
forms, which indicate explicitly the variables under considera¬ 
tion,* 

or 

\u,v,w J \u, V, w) 

Then 

/(*, V, 2) dV = jY(tt, V, w) • • du dv dw, 

where 


d<Pi 

du 

(48-3) J(.u, V, w) ^ 

d(pi 

dw 


F(u, V, w) S f[<pi(u, V, w), <P 2 (U, t>, w), <pz(u, V, w)l 

An interpretation of the meaning of the Jacobian, analogous 
to that of Sec. 47, is immediately available if one prefers to think 
of Eqs. (48-1) as defining the transformation of the points of 
the region R into the points of the region 22' in a cartesian coordi¬ 
nate system (u, v, w). The results of this and the preceding 
sections can easily be generalized to more than three dimensions. 

49. Spherical and Cylindrical Coordinates. Corresponding 
to the system of polar coordinates in the plane, there are two 
systems of space coordinates which are frequently used in prac¬ 
tical problems. The first of these is the system of spherical, or 
polar, coordinates. Let P{Xy z) (Fig. 42) be any point whose 
projection on the rc^z-plane is Q(x, y). Then the spherical 
coordinates of P are p, (Pj 6, in which p is the distance OP, <p is the 
angle between OQ and the positive a;-axis, and & is the angle 

* Another notation commonly used to denote the Jacobian is 

r a 


See Chap. XII 
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between OP and the positive z-axis. Then, from Fig. 42 it 
is seen that 

X ~ OQ cos ^ = OP cos (90° — 6 ) cos <p = p sia 0 cos <p, 
y = OQ sin v? = p sin sin <p, 
z = p cos d. 



Fia. 42. 


The element of voltime in spherical coordinates can be obtained 
by means of (48-3). Since 


/ x, y, 

\P, <P, 0/ 


it follows that 
(49-1) 


sin 9 cos <p sin 0 sin <p 

-p sin 9 sin ^ p sin 0 cos <p 

p cos 9 cos <p p cos 6 sin <p 

-p® sin 9, 


dV — p* sin 6 dp d<p dO. 


-p sin o\ 


This element of volume is the volume of the solid bounded by the 
two concentric spheres of radii p and p -|- dp, the two planes 
through the z-axis which make angles of <p and <p + d<p with the 
xz-plane, and the two cones of revolution whose common ajds 
is the z-axis and whose vertical angles are 29 and 2(9 -f d9). 

The second space system corresponding to polar coordinates 
in the plane is the system of cylindrical coordinates. Any 
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point Pix, y, z), whose projection on the a;y-plane is Q (Fig. 43), 
has the cylindrical coordinates p, d, z, where 6 is the angle between 
OQ and the positive a;-axis, p is the distance OQ, and z is the 



Fig. 43. 

distance QP. From Fig. 43 it is evident that x = p cos $, 
2 / = p sin $j and z = z. Since 

cos B sin B 0 

—p sin ^ p cos ^ 0 = p, 

0 0 1 

it follows that 

(49-2) dV = pdpdBdz, 

This element of volume is the volume of the solid bounded by the 
two cylinders whose radii are p and p + dp, the two planes 
through the jg-axis which make angles B and B + dO with the 
rr 2 -plane, and the two planes parallel to the ajy-plane at distances 
z and z + dz. 

Example 1. Find the a;-coordinate of the center of gravity of 
the solid of uniform density or lying in the first octant and bounded 
by the three coordinate planes and the sphere = aK 
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Since 





it is necessary to compute dV. This integral can be cal¬ 
culated by evaluating the iterated integral 

but it is easier to transform to spherical coordinates. Then, 


Therefore, 


r 7C 

m “ “ a 

p sin 0 cos V ■ P* s 

I 

n fVl" 

I I ^ sin* 9 cos <p dd d<(> 
Jo Jo *|o 

• 

• I cos if d<p 
Jo 


aV 

16 


aSr 

16’ 


5 = 


oV 

l6 

ira* 

" 6 " 


§1? 

“8“ 


Example 2. Let it be reqmred to calculate the moment of 
inertia J* of the cylinder used in the illustration of Sec. 46 by 
transforming the integral into cylindrical coordinates. Then 


m b 

^ (p* sin* 0 + 2 *)p dz do dp 
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= + ^p) dp 

- + 46-). 

50. Surface Integrals. Another important application of 
multiple integrals occurs in defining the area of a surface. The 
surfaces considered in this section are assumed to have two well- 
defined sides. If one draws two oppositely directed normals 
PN and PiV' at any point P of a two-sided surface (Fig. 44) 
and allows the point P to move along any path which does not 
cross the edge of the surface, then the direction of the moving 
normal PN can never be made to coincide with that of PiV'. 




There are surfaces that have one side only. Thus a strip 
of paper glued in such a way that the upper side of one end of the 
strip is joined onto the under side of the other end will form a 
one-sided surface (Fig. 45). If two oppositely directed normals 
PN and PAT' are drawn at any point P of this surface, then the 
normal PN, carried along the path PAPCP, will eventually 
coincide in direction with PN'. 

Let z = f{x, y) be the equation of a surface S (Fig. 46). The 
function z = f{x, y) is assumed to have continuous first partial 
derivatives with respect to x and y. This implies that a con¬ 
tinuously turning tangent plane is uniquely defined at every 
point of the surface S. 

Let S' be a portion of S bounded by a closed curve C, and such 
that any line parallel to the jgj-axis cuts S' in only one point. 
If C' is the projection of C on the x^z-plane, let the region P, 
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of which C is the boundary, be subdivided by lines parallel to 
the axes into subregions ABi. Through these subdividing lines 
pass planes parallel to the 2 -axis. These planes cut from S' 
small regions ASJ of area A<r<. Ijet AA* be the area of AJSI,-. 
Then, except for infinitesimals of higher order, 

AAi = cos Avi, 

where cos ou, cos ft, and cos yi represent the direction cosines 



of the normal to S at any point (xj, yi, 2 ,) of ASJ. 
Sec. 28) 


cos ai:cos ft : cos 7 ,- = 


dx 




- 1 , 


it follows that 


cos 7 ,- 



Using the positive value for cos 7 <, 


Since (see 


Affi — sec 7 < 




»-r 


Then 
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is defined as the area of the surface S'. Since this limit is 
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the value of <r is given by 

(50-1) ^ = l^sec ydA=^ j + (g)' + 1 dx dy. 

Similarly, by projecting S on the other coordinate planes, it 
can be shown that 

V = sec adA = sec dA. 

The integral of a function <p(x, y, z) over the surface z = f(x, y) 
can now be defined by the equation 

(50-2) JgV(x, y,z)dcr = 

/X*’ »■ + (I)’ +1 * * 

The outline of the reasoning leading to this definition is as 
follows: The surface S' is divided into regions ASi whose areas 
are A<ri, Let Pt(a;i, yi, Zi) be any point in AS'i and form* the sum 

n 

yi, Zi) Affi. 

The limit of this sum as n ^ oo, in such a way that every Aart —> 0, 
is called the surface integral of ^(a;, y, z) over S' and is denoted by 

y> 2) 

This integral can be evaluated with the aid of the formula (50-2). 

To ensure the existence of the limit, it is sufficient to assume 
that the function <p{x, y, z) is continuous and single-valued for 
all points of the surface S'. 

Example 1. Find the area of that portion of the surface of 
the cylinder x® -(- y* = o* which lies in the first octant between 
the planes 2 = 0 and z = mx (Fig. 47). 
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This surface can be projected on the a; 2 -plane or on the j/z-plane 
but not on the a;y-plane (since any perpendicular to the xy-plane 
which meets the surface of all will lie on the surface). The 
projection on the x 2 -plane is the triangle OAB. Hence 



Therefore, 

a = X*X”*®^** ~ dz dx 

= j^amx(a^ — x^)~^ dx = ahn. 

Example 2. Find the surface of the sphere a:® + J/* + 2* = o* 
cut off by the cylinder x* — ckc + j/* = 0 (Fig. 48). 

From S 3 nnmetry it is clear that it will suffice to determine the 
surface in the first octant and multiply the result by 4. Now, 

+(S) 

and since z = 
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Thus, the integral becomes 
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It is simpler to evaluate this integral by transforming to cylin¬ 



drical coordinates. The equation of the cylinder becomes 
p = o cos 9, and that of the sphere 

z = "v/ o* — a:* — y* — p\ 

Thus, 



a p dp do 

■\/— p^ 



Example 3. Find the z-coordinate of the center of gravity of 
one octant of the surface of the sphere a:* •+■ y* -j- z* = o*. 

Now, 



TO* 


o 

2 * 


0 Jo 


adxdy 
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PROBLEMS 

1. Find the rolxime bounded by the cylinder and the sphere of 

Example 2, page 164. ^ ~ 3^ 

2. Find the surface of the cylinder a:® + y® = a® cut off by the cylinder 

y* 4 - a* Am. 8o“. 

3. Find the coordinates of the center of gravity of the portion of the 
surface of the sphere out off by the right-circular cone whose vertex is 

i — ot 

at the center of the sphere- -An®, x ^ a cos® 

4. Use cylindrical coordinates to find the moment of inertia of the 
volume of a right-circular cylinder about its axis, Ans, 

6, Find the moments of inertia of the volume of the ellipsoid 


a® c® 


1 


about its axes. Ans. J, *= ^5a5c(a® + 6®). 

6. Kinetic energy T is defined as T ~ where M is the mass 

and V is the velocity of a particle. If the body is rotating with a constant 
angular velocity w, show that 

T = pdV = 

where p is the density and I is the moment of inertia of the body about 
the axis of rotation. 

7. Find the coordinates of the center of gravity of the area bounded by 

a; == 0, and y = 0. 

8. Find the moment of inertia of the area of one loop of p® « a® sin 26 
about an axis perpendicular to its plane at the pole. 

9. (a) Find the expression for dA in terms of u and Vjit x ^ t^(l — v) 
and y = uv; 

(6) Find the expression for dV in terms of Uj v, and w?, if a? »» t^(l — v), 
y = uv{l — w), and z = um. 

10. Find the center of gravity of one of the wedges of uniform density 
cut from the cylinder x® + y® » a® by the planes z ^ mz and z » — 

11. Find the volume enclosed by the circular cylinder p *= 2a cos 6, 
the cone z - p, and the plane 2 : = 0 (use cylindrical coordinates). 

12. Find the center of gravity of the solid of uniform density bounded 

by the four planes ? -f r + ~ 1, a; = 0, y = 0, and a; *= 0. 

a 0 c j j 

13. Find the moment of inertia of the solid of uniform density bounded 
by the cylinder a;® + y® - a® and the planes as » 0 and z ^ b about the 
a^axis. 
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14. Find, by the method of Sec. 50, the area of the surface of the 
sphere = a* which lies in the first octant. 

16. Prove that 



Hira: Write out the Jacobians and multiply. 
16. Prove that 


y) V 77/ 


where u = u{x, y), v = v(Xj y), x = x(i, tj), and y = y{^, ij). 



51. Green’s Theorem in Space. An important theorem that 
establishes the connection between the integral over the volume 
and the integral over the surface enclosing the volume is given 
next. This theorem has wide applicability in numerous physical 
problems and is frequently termed the divergence theorem. 

Theorem. If P(x, y, z), Q(x, y, z), R{x, y, z) and 
dR 

— are continuous and single-^valv^ed functions in a region T hounded 
by a closed surface Sj then 
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J^(Pcos« + Ocos/5 + Bco8y)da = ^ + ^)dF. 

It will be assumed that S (Fig. 49) is cut by any line parallel to 
one of the coordinate axes in at most two points. If jS is not 
such a surface, then T is subdivided into regions each of which 
satisfies this condition, and the extension to more general types 
of regions presents no diflSculty. 

A parallel to the 2 -axis may cut S in two points (x<, pi, Z{) and 
{xi, Vi, ii), in which 2 i < 2*. Let 2 = fi(x, y) be the equation 
satisfied by (*<, pi, zi) and z = /»(«, y) be the equation satisfied 
by (xi, Pi, 2j). Thus /S is divided into two parts: Si, whose equa^ 
tion is 2 = /i(x, y) ; and St, whose equation is 2 = /»(®, y). Then 

fgR(x, y, z) cos r dv, 

taken over the exterior of S, is equal to 

fgR(.x, y, z) cos y d<r -4- fgB{x, y, z) cos y da, 

taken over the exteriors of the surfaces Si and St. But, from 
(50-2), these surface integrals are equal to double integrals taken 
over the projection T' of T on the xj/-plane. Therefore,* 

J^B(x, y, z) eoay da = j^{B[x, y,Mx, y)] - R[x, y,fi{x, y)]} dA 

■ JJ/rS *'*''*’ 

or 

J^fi(x, y, z) cos 7 dff = dV. 

Similarly, it can be shown that 

j P(x, y, z) cos a da — f dV 
JS JTOX 

* The negative sign appears in the right-hand member of the equation 
because 

cos Yi dcTj » —cos 71 dati, 
where the subscripts refer to St and 8 i. 
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Therefore, 



Q(x, y, z) cos /3 dv 



dV. 


(61-1) + Q cos /3 -f- jK cos y) da 

jrV^a; ^ dy^ dz)^^' 
Since cos ada = dy dz, cos da = dz dx, and cos y da = dx dy, 
(51-1) can be written in the form 

(51-2) {P dy dz + Qdzdx Rdx dy) 

JJX(£ 

The formula (61-2) bears the name of Green.* 

Example. By transforming to a triple integral, evaluate 

dy dz + x^y dz dx + x^z dx dy), 

where S is the surface bounded \>jz = Q,z ^ h, and x^ + y^ ^ a^. 
Calculating the right-hand member with the aid of (51-2) 
and making use of the sjunmetry, one finds 

^ ^ 

= 4 • 5bj‘Jx^-\/ a* — x^ dx 
= ^Tra^b. 

A direct calculation of the integral I may prove to be instructiva 
The evaluation of the integral can be carried out by calculating 
the sum of the integrals evaluated over the projections of the sur¬ 
face S on the coordinate planes. Thus, 

I ~ a® — 2/*)* dz dy — — y“)* dz dy 

+ ~ dx J^^'’a:*(—Vo* “ *0 dz dx 

*The names of Gauss and Ostrogradsky are also associated with this 
theorem. 
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which upon evaluation is seen to check with the result obtained 
above. It should be noted that the angles a, pj y are made by 
the exterior normal with the positive direction of the coordinate 
axes. 

62. Symmetrical Form of Green’s Theorem. One of the most 
widely used formulas in the applications of analysis to a great 
variety of problems is a form of Green's theorem obtained by 
setting 


dv 

U—f 

ox 


Q ^ u 


—j 

dy 


R 


u 


dz 


in (51-1). The result of the substitution is 



. dv ^ 

« + _C0S/?+-C087 


■) 


d<r 


JA 


— 4- — J- 

ax» ay* ^ 


+ 


X(; 


1 ) 


dV 


du dv . du dv 
dx dx dy dy 


du aA 
dz ai/ 


dV. 


But the direction cosines of the exterior normal n to the surface 
are 


cos a 



cos p — 


an 


cos y == 


§1 

dn 


so that the foregoing integral reads 


(52-1) 


where 


dv . r 

d<r = \ u 
dn J jf 




+ 


r /du dv 

Jt\^^ ax 


^ At/ Att ~ •> I “»'• 


V*t; » 


a*p , a^ 
ax* ay* 


+ 


a*t» 

ax*‘ 


Interchanging the roles of u and v in (62-1) and subtracting the 
result from (62-1) give the desired formula 




V v*«) dV. 
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A reference to the conditions imposed upon P, Qj and E in 
the theorem of Sec. 51 shows that in order to ensure the validity 
of this formula, it is sufficient to require the continuity of the 
functions u and v and their first and second space derivatives 
throughout a closed region T. 


PROBLEMS 

1. Evaluate, by using Greenes theorem, 


dydz + y^dzdx + yz 


where S is the surface a;* + = a*. 

2. Show from geometrical considerations that the angle dd subtended 
at the origin by an element ds of a plane curve C is 


dd 


cos(n, f) —^ 


where r is the radius vector of the curve, and (n, r) is the angle between 
the radius vector and the normal to the curve. Hence, show that 

0 — (n, r) da _ r 1 dr ^ 

Jc Jc r dn ' 

where the integral is a line integral along the curve (7. 

3. A solid angle is defined as the angle subtended at the vertex of a 
cone. The area cut out from a unit sphere by the cone, with its vertex 
at the center, is called the measure of the solid angle. The measure of 
the solid angle is clearly equal to the area cut out by the cone from any 
sphere concentric with the unit sphere divided by the square of the 
radius of this sphere. In a manner analogous to that employed in 
Prob. 2 show that the element of solid angle is 

, cos(n, r) dcr 

Hm --• 


where the angle between the radius vector and the exterior normal to 
the surface S is (n, r). Also show that 


6) 


cos (n, r) der 


-ih 


d<r, 


where the integral is extended over the surface S. 

4. By transforming to a triple integral, evaluate 



dy dz + dzdx + dx dy, 
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where S is the spherical surface ^ aK Also attempt to 

calculate this integral directly. 

5 . Set t; = 1 in Green's symmetrical formula and assume that u satis- 

J f* du 

is an arbitrary closed surface? 

6 . The density of a square plate varies directly as the square of the 
distance from one vertex. Find the center of ^avity and the moment 
of inertia of the plate about an axis perpendicular to the plate and 
passing through the center of gravity. 

7. Find the volume of a rectangular hole cut through a sphere if a 
diameter of the sphere coincides with the axis of the hole. 

8 . Show that the attraction of a homogeneous sphere at a point 
exterior to the sphere is the same as though aU of the mass of the sphere 
were concentrated at the center of the sphere. Assume the inverse 
square law of force. 

9. The Newtonian potential V due to a body T at a point P is defined 

by the equation F(P) == where dm is the element of mass of the 

body and r is the distance from the point P to the element of mass dm. 
Show that the potential of a homogeneous spherical shell of inner 
radius h and outer radius a is 


and 


V = 27r<r(a« - if r < 6 , 

4 

•^(T—-—; if r > a, 


where <r is the density. 

10. Find the Newtonian potential on the axis of a homogeneous 
circular cylinder of radius a. 

11. Show that the force of attraction of a right-circular cone upon a 
point at its vertex is 2 T(rh{l ~ cos a), where h is the altitude of the cone 
and 2 a is the angle at the vertex. 

12. Show that the force of attraction of a homogeneous right-circular 
cylinder upon a point on its axis is 


27r<r[^ + 4- a® — V (P + hy + a^], 


where h is altitude, a is radius, and P is the distance from the point to 
one base of the cylinder. 

13, Set up the integral representing the part of the surface of the 

sphere -f ^2 ^252 - iqo intercepted by the planes a? « 1 and a; =* 4 . 

14. Find the mass of a sphere whose density varies as the square of 
the distance from the center. 

16. Find the moment of inertia of the sphere in Prob. 14 about a 
diameter. 
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16. A circular hole of radius h is drilled through a sphere of radius a. 
What is the volume drilled out if the axis of the hole coincides with a 
diameter of the sphere? 

17. A circular hole of radius b is drilled through a circular cylinder of 
radius a in such a way that the axis of the hole coincides with a diameter 
of the cross section of the cylinder. What is the volume drilled out? 

18. Set up the integral for the area of the surface of the sphere inter¬ 
cepted by a right-circular cylinder one of whose elements contains a 
diameter of the sphere. Evaluate this integral if the radius of the 
cylinder is equal to one-half the radius of the sphere. 

19. If a sphere is inscribed in a ri^t-circular cylinder, then the 
surfaces of the sphere and the cylinder intercepted by a pair of planes 
perpendicular to the axis of the cylinder are equal in area. Prove it. 



CHAPTER VI 
LINE INTEGRALS 


63. Definition of Line Integral. Consider a continuous curve 
C (Fig. 60) joining the points A and B, whose coordinates are 
(o, b) and (c, d). Let M{x, y) and Nix, y) be two single-valued 

and continuous* functions of x 
and y for all points of C. Divide 
the curve C into n arcs by- 
inserting n — 1 points Pi whose 
coordinates are (xi, y^, and define 

m Xi — Xi^i 

and 

Ayi = Vi - Vi-i, 

with i = 1, 2, • • • , ra, where 

Xo so, yo a h, X„ = c, y„ S d. 

On each of the n arcs choose a point (^i, y<), and form the sum 

n 

(53-1) Xm^i, Vi) Axi + Ni^i, Vi) Ayil 

I t-l 

The limit of this sum as n—« and every Axi and tends to 
zero is defined as a line integral along the curve C, or in symbols 

n 

lim ]£[Af({<, Vi) Axi + Niii, vd Aj/<] 

n-+ 00 

f "■! 

® fflMix, y) dx 4- Nix, y) dy]. 

* A function F (x, y) is continuous along the curve C if it is continuous at 
every point of C, The continuity at a point (aJo, 2/o) of the curve C means 
that lim F{x, y) » F{x^, yo) when the point {x, y) approaches (so, |/o) along 

af~+a;o 

I/~+yo 

C, that is, \F (xj y) — F(xo, j/o) | < «for all points of the curve C that satisfy 
the inequalities \x — ajoj < and \y — 2/o| < ly, 

174 
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Fig. 50. 
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The fact that the Imnt of the sum exists independently of the 
mode of subdivision and of the choice of the points 
follows directly from the existence of the ordinary definite integral 
if the curve C is assumed to be such that it can be broken up into 
a finite number of monotonic arcs. For, let the equation of the 
curve C be 

y = 

and assume that C is such that a hne parallel to either of the 
coordinate axes meets the curve in, at most, one point* (Fig. 51). 



Divide this curve into n arcs by inserting the points of sub¬ 
division Pij (t = 1, 2, • • • , n — 1), the coordinates of which 
satisfy the conditions 

d = .Co •Tl ^ j 

b ^ yo < yi < y 2 < * • * < 2 /n-i < yn = d, 
and form the sum 

n n 

(53-2) ,0 Axi = m] AXi. 

t—l i-1 

Since M[x, f(x)] is a continuous function, the limit of the sum 
(53-2) as » 00 is precisely the ordinary definite integral, so 

that one can write 

n 

lim VM({i, iji) fi^y\ 

* This is equivalent to saying that the function f(x) is monotoner 
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Denote the inverse of y = f(x) by x = tp(y); then a precisely 
similar argument shows that 


lim rji) Ayi = lim »?<] Ay< 

"—€-1 

= j^NWiy), y] dy. 

Thus the line integral 
(53-3) 

can be expressed as the sum of two definite integrals if the curve 
C is continuous and monotone. This discussion can be extended 
in an obvious way if the continuous curve C can be subdivided 
into a finite number of pieces each of which is monotone. 

It is clear from the foregoing that the magnitude of the line 
integral depends, in general, on the choice of the curve C joining 
the points A and J3, but it should be noted that the definition 
of the line integral does not require the existence of the derivative 
of fix). 

If the equation of the curve C is given in a parametric form as 

X = flit), 

y = hit\ iu^t^ h), 

where fiit) and f%it) possess continuous derivatives, one can 
express the line integral (53-3) as a definite integral by sub¬ 
stituting for X and y in terms of t. Thus, 

fjMix, y) dx + Nix, y) dy] 

= + NmtiMtMm dt, 

where to and h are the values of the parameter t which correspond 
to the coordinates of the end points A and B. 

If the equation of the curve is given in the form Hx), 
where f'(x) is a continuous function, then dy = fix) dx, and 
substitution in the line integral (63-3) gives the definite integral 

fj.Mix, y)dx + Nix, y) dy] = { M[x, fix)] -f- N[x, fix)]f ix )} d*. 

It follows from the properties of definite integrals that the 
line integral along the curve C from the point A to the point B 
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is the negative of the line integral from B to A along the same 
curve. 

Example 1. Let the points (0, 0) and (1, 1) be connected by 
the line y = x. Let M{x, y) = x - y* and N(x, y) = 2xy. 
Then the line integral along j/ = x, 

^ ~ ^y^’ 

becomes, on substitution oiy = x, 

[(x — X*) dx + 2x® dx] = J^(x + X®) dx = %. 

If (0, 0) and (1, 1) are connected by the parabola y = x'^, I along 
y = X* is 

j^^[(x - X*) dx + 2x®(2a: dx)] == j^\x + 3x^) dx = i>fo- 
Example 2. Consider 


y) = 2x* + Axy 

and 

N{x, y) = 2x* — y^, 

with the curve y — x^ connecting the points (1, 1) and (2, 4). 
Then 


J(uf + IV’ dy) = ^^(2a:* + 4x • x*) dx + j^{2y - y^) dy 

= 13%. 

Inasmuch as dp = 2x dx, this integral can be written as 

(2x* 4- 4x®) dx + ^(2x® — x®)2x dx = 13%. 

If the equation of the parabola in this example is written in a 
parametric form as 

X = t, 

y = t\ 2), 

then the-integrand of the line integral can be expressed in terms 
of the parameter t. Substituting for x, y, dx, and dy in terms of 
t gives 

dx + JV dp] = J^*[(2<* + 4<») 4- (2«* - <02f] d< 

= ^(2<* 4- 8<* - 2*“) di = 13%. 
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The reader will readily verify that the value of this integral 
over a rectilinear path C joining the points (1, 1) and (2, 4) is 
also 13%. In fact, the value of this integral depends only on 
the end points and not upon the curve joining them. The 
reason for this remarkable behavior will appear in Sec. 56. 


PROBLEMS 

1 . Find the value of dx + (x — }/) dp] along the following 

curves: 

(a) straight line x — t^y — 

(b) parabola x ^ y ^ t] 

(c) parabola x — t,y ^ P) 

{d) cubical parabola x = tj y — 

2. Find the value of dx + (x^ — y^) dy] along (a) y » 3a:*; 

(6) y == 3a:. 

3. Find the value of f ' (x* dx + dy) along the curves of Prob. 1 

*/ ( 0 , 0 ) 

above. 

4. Find the value of [(x* + j/*) dx — 2xy dy] along (a) y = x; 
(6) X = 2 /*; (c) y = x*. 

5. Find the value of I (y sin x dx — x cos y dy) along 2 / = x, 

(o»o)o) 

6. Find the value of f (x dy + y dx) along the upper half of the 

»/ (— 0 , 0 ) 

circle x* + 2/^ = a*. 

7. Evaluate the integral of Prob. 6 over the path formed by the lines 
X = —ajy==ajX = a. What is the value of this integral if the path 
is a straight line joining the points (—a, 0) and (a, 0)? 

(a:* dx + dy) along the path given by 

(i,0) 

x = sin tf y = cos t 

9. Evaluate the integral of Prob. 8 if the path is a straight line joining 
(0, 1) and (1, 0). 

10 . What is the value of the integral of Prob, 8 if the path is the curve 

2/ = 1 - X*? 


64. Area of a Closed Curve. Let C be a continuous closed 
curve which nowhere crosses itself. The equation of such a 
curve, in parametric form, can be given as 


(64-1) 


® = fiii), 
V = Mt), 
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where the parameter t varies continuously from some value 
f = ^0 to ^ and the functions fi(t) and fnit) are continuous 
and single-valued in the interval to ^ t ^ fi. Inasmuch as the 
curve is assumed to be closed, the initial and the final points of 
the curve coincide, so that, 

and 

fiiU) == 

The statement that the curve C does not cut itself implies 
that there is no other pair of values of the parameter t for which 

/i(o =/i(n, 

and 

/2(o=/2(n. 

A closed curve satisfying the condition stated above will be 
called simple. 

As t varies continuously from to ti, the points {x, y) deter¬ 
mined by (54-1) will trace out the curve C in a certain sense. If 
C is described so that a man walk- 

y 

ing along the curve in the direction 
of the description has the enclosed ^2 
area always to his left, the curve C 
is said to be described in the positive 
direction^ Midi the enclosed area will 
be considered positive; whereas if C 
is described so that the enclosed 
area is to the right, then C is 
described in the negative direction^ 
and the area is regarded as negative. ^ 

Consider at first a simple closed 
curve C such that no line parallel - 
to either of the coordinate axes 
intersects C in more than two 
points. Let C be bounded by the lines x ^ ai, x a 2 , y 61 , 
y = 62 , which are tangent to C at Ai, A 2 , JBi, and Bzy respec¬ 
tively. Clearly C cannot be the graph of a single-valued 
function. Therefore, let the equation of AiBiA^ be given by 





Fio. 52. 
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yi =/i(a:), and the equation of AiBiAi by 3/2 = hix), where 
fi{x) and Mx) are single-valued functions. Then the area 
enclosed by C (Fig. 52) is given by 


(54-2) 


A = dx — J^yi dx 

= -fy^dx -ly^dx, 


(54-3) 


= -lydx, 


in which the last integral is to be taken around C in a counter¬ 
clockwise direction. 

Similarly, if xi = <pi(y) is the equation of jBi. 4 iB 2 and Xi = <pi{y) 
is the equation of BiAiBi: 


A = r’xt dy - f^xi dy 

= £x^dy + fyx,dy 


(54-4) 


A =J/cdy. 


Again, the last integral is to be taken around O' in a counter¬ 
clockwise direction. It may be 
y t noted that (54-3) and (54-4) both 

require that the area be to the 
left as C is described if the value 
<2)/^ j of A is to be positive. 

ja} By adding (54-3) and (54-4), a 

/ / new formula for A is obtained, 

/ namely, 


(54-6) A = ^dx + x dy). 


Vio. 63 . This formula gives a line-integral 

expression for A. 

To illustrate the application of (64-6), the area between 
( 1 ) a:* = iy and ( 2 ) == 4« (Fig. 63) will be determined. 
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A 



y dx + X 



i—y dx + X dy) 



+ s( (.-ydx + xdy) 
-y -^dy + ^dy'^ 


For convenience the first integral was expressed in terms of x, 
whereas the second integral is simpler in terms of y. 

The restriction that the curve C be such that no line parallel 
to either of the coordinate axes cuts it in more than two points 
can be removed if it is possible to draw a finite number of lines 
connecting pmrs of points on (7, so that the area enclosed by 
the curve is subdivided into regions each of which is of the t 3 ;^ 
considered in the foregoing. This extension is indicated in 
detail in the following section. 


PROBLEMS 

1. Find, by using (54-5), the area of the ellii)se x — a cos <pfy — hsm<p. 

2. Find, by using (54-5), the area between y* = 9a; and y = 3a;. 

3. Find, by using (54-5), the area of the h 3 rpocycloid of four cusps 
a; = a cos* y == a sin* $. 

4. Fmd, by using (54-5), the area of the triangle formed by the line 
a; + 2/ = a and the coordinate axes. 

6. Find, by using (54-5), the area enclosed by the loop of the strophoid 


1 - <2 t{l - «*) 

1 + t^' 1 + t^ 


66. Green’s Theorem for the Plane. This remarkable theorem 
establishes the connection between a line integral and a double 
integral. 

dikf" SN 

Theorem. Jf M(x, y) and N (*, y), and ^ are continuom, 

singl&^oalued functions over a closed region B, hounded by the curve 
C, then 
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The double integral is taken over the given region, and the curve C is 
described in the 'positive direction. 

The theorem will be proved first for a simple closed curve 
of the type considered in Sec. 54 (see Fig. 52). 

Again let j/i = he the equation of A-jJBiAt, and yt = fi{x) 
be the equation of AiBiA^. Then 



r at 

[M{x, yt) - M(x, yi)]dx 



or 

(55-1) j ^ 

Similarly, if a:i = <piiy) is the equation of BxAiBi and xj - <pi{y) 
is the equation of BxAxBi, 



- /j 

I N{xi, ■y)dy j N{xx, y) dy, 

iJ hi Jhi 


Wixt, y) - N{xx, y)] dy 


or 


Therefore, if (55-2) is subtracted from (55-1), 

(65-3) J jjM-^dxdy=-jj,M(x,y)dx + N(x,y)dy]. 

It will be observed that setting M — —y and N => x gives the 
formula (54-5). 

Now let the region have any continuous boundary curve C, so 
long as it is possible to draw a finite number of lines which 
divide the region into subregions each of the type considered in 
the first part of this section; that is, the subregions must have 
boundary curves which are cut by any parallel to either of the 
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coor<iin. 8 it 6 81 X 6 S in fit most two points. Sucli fi rogion R is sliown 
in Fig. 54. 

By drfiwing the lines A 1 A 2 and AstAi, the region R is divided 
into three subregions Ri, R^, and Ri. The boundary curve of 
each region is of the simple type. The positive direction of 
each boundary curve is indicated by the arrows. The theorem 
can be applied to each subregion separately. When the three 
equations are added, the left-hand members add to give the 



Fig. 54. 


double integral over the entire region JR. The right-hand 
members give 

- dx + N dy] - dx + N dy] - {M dx + N dy], 

where 

Cl = A1B1A2 + A^Ai, 

C 2 = .4.1^2 H” A 2 B 2 AZ “b 48^4 "b 4 . 44 . 1 , 

Cz = 4443 -f" 48£844* 

Since each of the lines 4i42 and 4844 is traversed once in each 
direction, the line integrals which arise from them will cancel. 
The remaining line integrals, taken over the arcs of C, add to 
give the line integral over C, Therefore, 

JX(f - S) .i* = -X(J^ ■*« + »<!») 

holds for regions of the type B. 
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Another type of region in which an auxiliary line is introduced 
is the region whose boundary is formed by two or more distinct 
curves. Thus, if R (Fig. 55) is the region between Ci and Ci, the 
line A 1 A 2 is drawn in order to make the total boundary 

Cl 4* AiAi 4- C 2 4- AiAz 

a single curve. The theorem can be applied, and the line 
integrals over A 2 A 1 and A 1 A 2 will cancel, leaving only the line 
integrals over Ci and Ci. 

If the region B is such that any closed curve drawn in it can, 
by a continuous deformation, be shrunk to a point without 




Fig. 6S. 

crossing the boundary of the region, then the latter is called 
simply connected. Thus, regions bounded by a circle, a rectangle, 
or an ellipse are simply connected. The region R exterior to 
Ci and interior to Ci (Fig. 55) is not simply connected because a 
circle drawn within R and enclosing Ci cannot be shrunk to a 
point without crossing Ci. In ordinary parlance, regions that 
have holes are not simply connected regions; they are called 
multiply connected regions. The importance of this classification 
will appear in the next two sections. 

Example. Evaluate by using Green’s theorem 

j^(a:*y dx 4- j/» dy), 

where C is the closed path formed by j/ = a: and y* = a;* from 
(0. 0) to (1, 1) (Fig. 56). Since M = x^ and N = y*, 
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Then, 



dx + y<f dy) 



dzdy 



44' 


PROBI^MS 

1. Find, by Green’s theorem, the value of 


j^(a:Syda: + 

along the closed curve G formed hy y'^ = x &aAy = x between (0, 0) 
and (1, 1). 

2. I^d, by Green’s theorem, the value of 

+ y)dx+ {x — y*) dy] 

along the closed curve C formed by y* = and y = x between (0, 0) 
and (1, 1). 

3. Use Green’s theorem to find the value of 

— x^) dx + x^ dy] 


along the closed curve C formed by y = 0, a; = 1, and y = x. 

4. Use Green’s theorem to evaluate 


XG‘■*'+:*) 

along the closed path formed by y = 1, a? = 4, and y = + V^* 

6. Check the answers of the four preceding problems by evaluating 
the line integrals directly. 


66. Properties of Line Integrals. 

Theorem 1. Let M and N be two functions of x and y, sttch that 
jif ^ continuous and single-valued at every point 

of a simply connected region i2. The necessary and sufficient 
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condition that dx N dy) — 0 around every dosed curve 

C drawn in R, is that 

iM = 

dy dx’ 

for every point of B. 

Since 

where A is the region enclosed by C, it follows that 

SM dN 
dy dx 

makes the double integral, and consequently the line integral, 
have the value zero. Conversely, let £(Mdx-hNdy) =0 
around every closed curve C drawn in B. Suppose that 

dy dx^ 


at some point P of R. 
tions of X and y, 


Since and ^ are continuous func- 
dy dx 


dM m 
dy dx 


is also a continuous function of x and y. Therefore, there must 

exist some region S about P, in which ^ has the same 

<jy qx 

sign as at P. Then 

and Hence ^{M dx + N dy) jA 0 around the boundary of this 
region. This contradicts the hypothesis that 


f^(Mdx + Ndy) = 0 
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around every closed curve C drawn in R. It follows that 

dy dx 

at all points of R. 

Example 1. Let 


Then 

m 

dy 


+ y^ 

m ^ 

dx (x* + y^y 


4- y* 


M, N, and ^ are continuous V 

and single-valued for all points of T ^ \ ^ 
the xy-plane except (0,0). Hence ) 

J^(M dx + JN dy) = 0 around any 

closed curve C (Fig. 67) which Fia.57. 

does not enclose (0, 0). In polar coordinates, obtained by the 
change of variables, 

X = p cos 0, y = p sin 6, 

If C does not enclose the origin, $ varies along C from its original 
value do back to ^o. Therefore, Jjid = 0. If Ci encloses the 

origin, 6 varies along Ci from do to + 27 r, so that f = 2 t. 

JCi 

Example 2. Find, by Green’s theorem, the value of 
I = + xy)dx + (j/* 4- X*) dy], 


where C is the square formed by the lines j/ = +1 and x = ±1. 
Since 
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Note that the line integral has the value zero, but 

This does not contradict Theorem 1. Why? 

Theorem 2. Let M and N satisfy the conditions of Theorem 1. 

The necessary and sufficient condition that (M dx N dy) 


be independent of the curve connecting {a, h) and {x, y) is that 

= — at alt points of the region B. In this case the line inte- 
dy dx t' j » 

gral is a function of the end points 



Suppose 


dM dN 


Let Cl and 


dy dx 
Ci (Fig. 58) be any two curves from 
A to P, and let 


-*~x 


and 


Ii sa dx~\- N dy) 
= f^iMdx + Ndy) 


be the values of the line integral from A to P along Ci and Cj, 
respectively. Then Ji — J* is the value of the integral around 
the closed path formed by Ci and 0%. By Theorem 1, 

Ii — /a = 0. 


Therefore, h = la, so that the line integral taken over any two 
paths from A to P has the same value. 

Conversely, suppose that ^{Mdx-\-N dy) is independent of 
the path from .d to P. Then, for any two curves Ci and Ca, 
Ii = /a. It follows that dx-\-N dy) « 0 for the closed path 

formed by Ci and Ca. Hence, by Theorem 1, 

dy dx 

Example. Consider 



l+a: 

X* 



Since ^ ^ and ^ Iwjfb functions are continuous 

except at (0, 0), the line integral is independent of the path so 
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long as it does not enclose the origin. Choose y = 1 from 
(1, 1) to (2, 1), and x = 2 from (2, 1) to (2, 2), as the path of 
integration. Then 


B-f: 






9 

' 8 * 


Theorem 3. Let M and N satisfy the conditions of Theorem 1. 
The necessary and sufficient condition that there exist a function 


F(Xj y) such that 


dx 


M and ^ 
dy 


N is that 


dM dN 


points of the region R. 


dy 


= ^ at cdl 
dx 


If 


dM dN 


dy 


—> Theorem 2 proves that 


f^\Mdx + Ndy) 

is independeat of the path. Therefore, 

(56-1) (Mdx + N dy) = F(x, y), 

and this function F{xj y) depends 
end points of the path. Hence, 

Fix + ^x, y) = 

Let the path of integration be 
chosen as a curve C (Fig. 59) from 
A to P and the straight line 
PP' fromPix, y) toP'ix + Ax, y). 

Then, 

F{x + Ax,y) = f^^iMdx -h Ndy) -J- f‘^\Mdx + Ndy) 
or 

(56-2) F(x + Ax, y) = F{x, y) -f j^'''^M{x, y) dx. 

The second integral reduces to the simpler form given in (56-2) 
since ^ is constant along PP', and therefore dy = 0. From (56-2) 


only on the coordinates of the 



Fia. 69. 
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^ _ lim >(3: + Aa:, y) - F{x, y) j 
dx A* J 

Application of the first mean-value theorem* gives 

y) dx = Lx Mii, y), {x ^ li S. x Ax). 

Therefore, 

f = limri-Aa:Jlf(f,j/)] = UmM(f,j/). 

dx Aa^->oL A^ J ^—►O 

Hence, 

^ = M(x, y). 

It can be proved similarly that 

f = iV(x,y). 

The function F is really a function of both end points. Multiply- 

SF dF 

ing — = Mix, y) by dx and -^ = N{x, y) by dy gives 

dF==^dx + ^dy = Mix, y) dx Nix, y) dy. 

Thus, if 

dy dx’ 

the integrand in J^iM dx + N dy) is the exact differential 

of the function Fix, y), which is determined by the formula 

( 66 - 1 ). 

The most general expression for a function #(a;, y), whose 
total differential is d‘i = M dx + N dy, is 

#(x, y) = Fix, y) + C, 


* See Sec, 37, 
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where C is an arbitrary constant. Indeed, since dF and d$ 
are equal, 

d{F - #) = 0, 

so that 


F — $ = const. 


To prove the necessity of the condition of the theorem, note 
that if there exists a function F{x, y) such that 

% = M{x,y) and ^ = Nix,y), 

then 

d^F ^ aM dW _ dN 

dy dx ~ dy dx dy ~ 'W 

dM j dN , dW , dW 

bmce — and — are both contmuous, -r—r- and t—— are also 
oy ox ox dy dy dx 

continuous, and hence,* 


dW ^ dW 
dx dy dy dx 

Therefore, 

dM 

dy dx 

As a corollary to Theorem 3, one can state the following: 
The necessary and sufficient condition that M{x, y) dx + N{x, y) dy 

be an exact differential is that 

dy dx 


1. Show that 


PROBUSMS 


+ y’) die + 2xy dy\ 

is independent of the path, and determine its value* 
2. Test for independence of path: 


(«) J (y COB xdx + am X dy); 
(b) J* [(a:* -y^)dx + 2ixy dy]; 
* See Sec. 31. 
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(c) J*[(* - y^)dx + 2xy dy]; 

(d) ~ 2(a: — l)y dy]. 


3. Show that ^ + (1 

the path and find its value. 

4u Show that the line integral 


is independent of 



—y dz 
x^ + y^ 


+ 


X dy 
iC* + 


evaluated along a square 2 units on the side and with center at the origin 
has the value 2 t. Give the reason for failure of this integral to vanish 
along this closed path. 

6. Find the values of the following line integrals: 


(а) 

( б ) 
(c) 


i 


(ii) 


(y (io&xdx+ sin x dy). 


( 22 ) r xy dx ^ 
I'y/l — 


VT— 


(0,0) 

(2.3) 


J ^( 2 . 3 : 

(14) 


[{x +l)dz + {y + l) dyl 


67. Multiply Connected Regions. It was shown that the 
necessary and sufficient condition for the vanishing of the line 

integral y) dx + N{x, y) dy] around the closed path C 

is the equality of and ^ at every point of the region enclosed 


by (7. It was assumed that C was drawn in a simply connected 
region R and that the functions M{xj y) and N{x, y), together 
with their first partial derivatives, were continuous on and in 
the interior of C. The latter condition was imposed in order to 
ensure the integrability of the functions involved. The reason 
for imposing the restriction on the connectivity of the region 
essentially lies in the type of regions permitted by Green's 
theorem. 

Thus consider a region R containing one hole (Fig. 60). The 
region R will be assumed to consist of the exterior of C% and the 
interior of C . Let a closed contour C be drawn, which lies 
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entirely in R and encloses Cj. Now, even though the functions 
M{x, y) and JV(x, y) together with their derivatives naay be 

continuous in R, the integral jjM{x, y) dx + Nix, y) dy] 

may not vanish. For, let K be any other closed curve lying in R 
and enclosing Ci, and suppose that the points A and B of K 
and C be joined by a straight line AB Consider the integrals 



where the subscripts on the integrals indicate the direction of 
integration along the curves K, C, and along the straight line AB, 
as is indicated in Fig. 60. Since the path AB is traversed twice 



Fig. 60. 

in opposite directions, the second and the last of the integrals 
above will annul each other, so that there will remain only the 
integral along K, traversed in the counterclockwise direction, 
and the integral along C, in the clockwise direction. Now if M 
and N satisfy the conditions of Theorem 1, Sec. 56, then 

dx + N dy] = 0, 

where the arrows on the circles indicate the direction of integra¬ 
tion. Thus 

(57-1) dx + Ndy] = dx + N dy], 

both integrals being taken in the counterclockwise direction. 

The important statement embodied in (57-1) is that the 
magnitude of the line integral evaluated over a closed path in R, 
surrounding the hole, has the same constant value whatever be 
the path enclodng Cj. This value need not be zero, as is seen 
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from a simple example already mentioned in Sec. 56. Thus, 
let the region B consist of the exterior of the circle of radius 
unity and with center at the origin and of the interior of a con- 



Pio. 61. 


and N = 7 and their derivatives, obviously satisfy the 

^ "T* y 


conditions of continuity in B and on Ci and Ct. Also, 


dM BN 
dy dx 


( -ydx _® 

+ J/* a:* + 




where C is the circle 


gives 


x = a cos (?, 

y = a sin 9, (1 < o < 3), 


rV8in*fl + a*cos*<>^^^ 
Jo a* 


The function F(x, y), of which M(,x, y) dx + Nix, y) dy is 
an exact differential, is Fix, y) — tan“‘ -> which is a multiple- 
valued function. 
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The function 

F{x, y) = y) dx + N{x, y) dy], 

where M and N satisfy the conditions of Theorem 1, Sec. 56, will be 
single-valued if the region R is simply connected (as is required 
in Theorem 1) but not necessarily so if the region is multiply 
connected. 

68. Line Integrals in Space. The line integral over a space 
curve C is defined in a way entirely analogous to that described 
in Sec. 56. 

Let (7 be a continuous space curve joining the points A and J5, 
and let P(xj y, z)^ Q(x, y, z)^ and R(x, i/, z) be three continuous, 
single-valued functions of the variables x, y, z. Divide the 
curve C into n arcs As* (i = 1, 2, • • • , n), whose projections 
on the coordinate axes are Axi, Ayi, Azi, and form the sum 

n 

’?•) fO + Q{^i, Vi, Ay,- + rji, f^) A*i], 

»-i 

where (ff, ijj, is a point chosen at random on the arc Ast. 
The limit of this sum as n increases indefinitely in such a way 
that each As< —> 0 is called the line integral oiP dxQdy B dz, 
taken along C between the points A and B. It is denoted by 
the symbol 

y, a) d* + Q{x, y, z) dy + B{x, y, z) dz]. 

The conditions imposed upon the fxmctions P, Q, and B are 
suflBicient to ensure the existence of the limit, provided that the 
CTirve C is suitably restricted. 

If the equation of the space curve C is given in parametric 
form as 

lx = fl(t), 

( 68 - 2 ) \y=m, 

U = Mt), <i), 

where /s( 0 > and /j(i) possess continuous derivatives in the 
interval to ^ t ^ ti, the line integral (58-1) can be expressed 
as a definite integral 
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£lP -m + Q ■/*(<) + P -f'M dt 

where P, Q, and R are expressed in tenns of t with the aid of 
(58-2). 

69. Stokes’s Theorem. Simply connected regions only will be 
considered in the remainder of this chapter. A simply connected 
space region is characterized by the fact that any closed curve 
drawn in it can be shrunk to a point without crossing the surfaces 
bounding the region. Thus, a cube, a sphere, a cylinder, or a 



region between two concentric spheres are examples of simply 
connected space regions. An anchor ring, or torus, is not simply 
connected. 

In considering closed surfaces, the direction of the exterior 
normal to the surface will be reckoned as positive. If the 
surface is open and two-sided (such as that of a henoisphere, for 
example), the direction of the positive normal may be taken at 
will. Let an open two-sided surface S be bounded by a closed 
curve r (Fig. 62); then the motion along T will be regarded as 
positive if a man walking along r with his head in the direction 
of the positive normal has the surface S to his left. 

Stokes’s Theorem. LetP(x, y, z), Q{x, y, z), and R{z, y, z) and 
their 'partial derivativea 'wUh reaped to x, y, and z be continuoua 
and aingle-oalued functiona in a region containing the aurface S 
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which ts bouuded hy the closed cv/rve r. Let dS he the element 
of area of /S, and let cos a, cos jS, and cos y be the direction cosines 
of the exterior normal to dS. Then 


^ \d3 dx) ^ ^ \dx dy J 

Let z = fix, y) be the equation of S and consider 
Fix, y, z) = P[x, y, fix, y)] s Mix, y). 
Let C be the projection of T on the ajy-plane, so that 

//(», y. 3) dx = fMix, y) dx. 
From Green’s theorem for the plane, 

where A is the pro j ection of S on the xy-plane. But 


cos 7 dS. 


dM _ dP , dP dz 
dy ~ dy dz dy 


so that 


jp(^, y,z)dx^-j X(f + SI) * 


Since* 

dzdz^ 

dx'dy' 

Moreover, 

Therefore, 


1 = cos a: cos 0: cos y, 

dxdy — cos y dS. 


^ cos 0 

dy cos y' 


(59-1) jp ix, y,z)dx = Jcoa0-^ cos 7 ) dS. 


* See Sec. 28 . 
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Similarly, it can be shown that 

(59-2) X® *“//(§“*■" 

(59^) X«*"XX(f«»“ 

By adding (59-1), (59-2), and (59-3), 

(59-4) J^(Pda; + <2di/4-iJd2) = - ^)co8a 

Using the fact that cos oc dS = dy dz, cos dS = dz dx, and 
cos yds = dx dy, (59-4) can be written in the form 

(59-6) X(P<te-t-Oi» + fi*!)- 

By means of this theorem, it is possible to derive three theorems 
analogous to those given in Sec. 56 for line integrals in the plane. 
Since the proofs of these theorems are similar to those given in 
Sec. 56, they will be omitted here. 

Theorem 1. Let the region of space considered be one in which 
P{Xf yy z)j Q{Xf Vy z), and B(x, y, z) and their partial derivatives are 
continuous and singte-valued functions of x, y, and z. Then the 
necessary and sufficient condition that 

J(P dx + Qdy + Bdz) = 0 

around every closed curve in the region is that 

dy dx^ dz dy* dx dz^ 
for every point of the region. 

Theorem 2. Let the functions considered satisfy the conditions 
of Theorem 1. Then the necessary and sufficient condition that 


— — cos diS, 
-gcos/3)d^. 
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be independent of the path from (a, &, c) to {x, y, z) is that 
dy dx dz dy' dx dz' 


for every point of the region. 

Theorem 3. Let the functions P, Q, and R satisfy the conditions 
of Theorem 1. Then the necessary and sufficient condition that there 
exist a function F(x, y, z), such that 


is that 




dz 




dy dx^ dz dy dx dz 


for every point of the region. The function F(x, y^ z) is given by the 
formula 


Fix, y, z) = dx-^Qdy + R dz). 

Corollary. The necessary and sufficient condition that 


P dx Qdy R dz 


be an exact differential of some function ^{Xj y, z) is that 

dP _ d^ d^ _ dR dR _ dP 

dy dx^ dz dy^ dx dz^ 

for every point of the region. The function ^{x, y^ z) is determined 
from the formula 

#(a;, y, z) = f/"'^f(P dx + Q dy + B dz) + const. 

60. Applications of Line Integrals. 

1. Change of Variables in a Double Integral. A formula for the 
change of variables in a double integral was developed in Sec. 
46, and it is advisable to review Secs. 46 and 47 before reading 
this section. A more elegant, though less direct, derivation of 
the relation established there is given below with the aid of the 
concept of the line integral. 

Consider again the eq^^ations of transformation of Sec. 46, 
(60-1) X = v), y = <p 2 (uj v), 
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where ^i(w, v) and tpi{u, v) together with their first partial 
derivatives are continuous in the region under consideration. 
The equations (60-1) may be regarded as the equations of trans¬ 
formation from one set of rectangular cartesian axes u, v to 
another set of rectangular axes x, y. The area A of the region B 
enclosed by the curve C is given by the formula (54-4), 

A=f^xdy. 


Substituting for x and dy from (60-1) gives 

(60-2) A = ») v), 

where C' is the boundary of the region R' in the wtvplane, which 
corresponds to the region B in the a;y-plane. 

But 


d<pi(u, ») = ^ ^ 


SO that the integral (60-2) becomes 

Setting 

and 


N{u, v) = <pi 


dtpi 

dv’ 


and applying Green’s theorem (Sec. 65) gives 


=n 

=/x 


H dv du 


d<pi d<pi\ 


du dv 
j7(M, t))| dudv, 


du dv 



leo 

where 
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J(Uj v) = 




du 

du 

dv 

dv 


It follows from the mean-value theorem for double integrals 
(see problem in Sec. 42) that 



dA = |J(^, rj)\ du dv. 

The absolute value bars were introduced in the foregoing because 
the area is essentially positive. 

2. Work. It will be assumed that a force F(rc, y) acts at every 
point of the aiy-plane (Fig. 63). 

This force varies from point to 
point in magnitude and direc¬ 
tion. An example of such con¬ 
ditions is the case of an electric 
field of force. The problem is to 
determine the work done on a 
particle moving from the point 
A (a, b) to the point B(c, d) along 
some curve (7. Divide the arc' 

AB of C into n segments by the 
points Pi, P 2 , . . . , Pn-i, and 
let Asi = PiP^i. Then the force acting at P» is F{xif yi). 
Let it be directed along the line PiS, and let PiT be the tangent 
to C at Pij making an angle 6i with PiS. 

The component of force F(xi, along PiT is F cos Bi and the 
element of work done on the particle in moving through the 
distance is approximately F{xi, y^ cos Bi As,*. The smaller 
As,*, the better this approximation will be. Therefore, the work 
done in moving the particle from A to jB along C is 

W = lim Vi) cos Bi As,* = v) ^ 

If a is the inclination of PiS and p is the inclination of P,r, 
then 

$ a — p and cos B == cos a cos p -h sin a sin 


Fig. 63. 
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so that 

(60-3) W = y)(fiOS a cos /? -+- sin a sin jS) ds. 

From the definition of a it is evident that 

F cos a — x-component of F = X, 

F sin a = y-comiwnent of F = F. 

Moreover, since ^ = cos |8 and ^ = sin j8, 

cos ds = dx and sin ds = dy. 

Therefore (60-3) becomes 

^ - x» dx -f- F dy'), 

which is a line integral of the form (53-3). 

If C is a space curve, then an argument in every respect 
similar to the foregoing shows that the work done in producing a 
displacement along a curve C in a field of force where the com¬ 
ponents along the coordinate axes are X, Y, and Z is 

W = fj^Xdx + Ydy-^Zdz). 

To illustrate the use of this formula, the work done in displac¬ 
ing a particle of mass m along some curve C, joining the points 
A and B, will be calculated. It will be assumed that the particle 
is moving under the Newtonian law of attraction 

p _ A:m 

where k is the gravitational constant and r is the distance from 
the center of attraction 0 (containing a unit mass) to a position 
of the particle (Fig. 64). 

The component of force in the direction of the positive x-axis 
is 

Fcos(x,r) = -^.1 
r* r 



km z 
r* r 


Similarly, 
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The work done in displacing the particle from A to B is 
W’ = — dx + ydy + z dz). 

But 


r = s/x^ y^ + z^ 


and dr = 

r 


Therefore, 



'r 

U r* 

_r_ 


which depends only on the coordinates of the points A and B 



and not on the path C. Denoting the distances from 0 to aI 
and B by n and ra, respectively, gives 



The quantity ^ = — is known as the gravitational potential 
of the mass m. It is easily checked that 


X 




Z 


dz' 


so that the partial derivatives of the potential function $ give 
the components of force along the coordinate axes. Moreover, 
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the directional derivative of $ in any direction s is 

d# 6$ dx ■ dy , 9$ ^ 

W ~ dx ds dy ds dz ds 

= X cos (x, s) + F cos (y, s) + Z cos (z, s) 

= F., 

where F, is the component of force in the direction s. 

A conservative field of force is defined as a field of force in 
which the work done in producing a displacement between two 



fixed points is independent of the path. It is clear that in a 
conservative field the integral 

f^iXdx + Ydy + Zdz) 

along every closed path is zero, so that the integrand is an exact 
differential. 

3. Flow of a Liquid, Let (7 be a curve on a plane surface across 
which a liquid is flowing. The zy-plane will be chosen to coincide 
with the surface. The lines of flow are indicated in Fig. 66 by the 
curved arrows. It will be assumed that the flow of the liquid 
takes place in planes parallel to the a;y-plane, and that the depth 
of the liquid is unity. The problem is to determine the amount 
of liquid that flows across C in a unit of time. 
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If Vi is the velocity of the liquid and a,- is the inclination of the 
tangent to the line of flow at P,-, then v^^i = Vi cos a,- is the a:-com- 
ponent of Vi and «i,|i = Vj sin oi is the ^/-component of Vu Let 
Asi denote the segment PiPi+i of C. A particle at Pi will move 
in time M to PJ while a particle at Pi+i will move to P'i+i- 
Therefore, the amount of liquid crossing PPifi in time At 
is equal to the volume of the cylinder whose altitude is unity 
and whose base is PJPi+iPi+iPJ. Aside from infinitesimals of 
higher order this volume is AFi = P<Pi • P<P^i sin d,-, in which di 
denotes the angle between P<PJ and P<Pj+i. But PfPi+i = As< 
and, except for infinitesimals of higher order, PiP^ = a,-At. 
Therefore AFi = Vi At • As,- sin di. The volume of hquid crossing 
C in a unit of time is 

F = lim Vwi sin Bi As,-. 

00 

E n denotes the inclination of the tangent to <7 at P,-, then 
Ti = di + oi. Therefore, 

Vi sin 6i A&i — »i(sin n cos on — cos n sin «<) Asi 

= Vi cos Oi sin Ti Asi — Vi sin on cos n Asi 
= t)»l< Ayi - v»|i AXi. 

Hence, 

(60-4) F = f^i—Vy dx + v^ dy) 

is the line integral which gives the amount of liquid that crosses 
(7 in a unit of time. 

If the contour C is a closed one and the liquid is incompressible, 
then the net amount of liquid crossing C is zero, since as much 
liquid enters the region as leaves it. This assumes, of course, 
that the interior of C contains no sources or si n ks. Thus, a 
steady flow of incompressible hquid is characterized by the 
equation 

f^(-Vy dx - 1 - Vs dy) = 0 , 

over any closed contour not containing sources or sinks. This 
imphes that (see Sec. 66) 

dVy _ dVs 

dy ~ dz’ 


( 60 - 6 ) 
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wiiicli is an important equation of hydrodynamics known as the 
equation of continuity. Moreover, from Theorem 3, Sec. 56, it is 
known that there exists a function ’3E" such that 


(60-6) 


dx 


= 


and 


dy 


This function 'f' is called the stream function, and it has a simple 
physical meaning, since 

y) == (“•'i' ^y) 

represents the amount of liquid crossing, per unit time, any curve 
joining (a, b) with (x, y). 

The function defined by the integral 

(60-7) $(», y) = dx -t- v„ dy), 

is called the velocity potential. It is readily shown that 


(60-8) ^ = v. and g 

Comparing (60-6) with (60-8), it is seen that 


a# a’®^ 

— -^T" and -r- = --:r" 

dx dy dy dx 

These are the celebrated Cauchy-Riemann differential equations. 

If the integral (60-4) around a closed curve C does not vanish, 
then the region bounded by C may contain sources (if F is 
positive) or sinks (if F is negative). The presence of sources 
or sinks is characterized by the singularities of the function 'f, 
that is, those points for which is not continuous or where its 
derivatives may cease to be continuous.* 

The foregoing discussion is readily generalized to a steady 
flow of liquids in space. Instead of the integral (60-7) one wiU 
have 

$(a:, y, z) = dx + Vy dy -{■ v. dz), 


* See in this connection Sec. 57. 
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and if this integral is independent of the path C, the equations 
corresponding to (60-5) are 

^ — ^ = 0 ^ = 0 —o 

dy dx ' dy dz ' dz dx~' ' 

In such a case the integrand is an exact differential, and the 
velocity potential y^ z) gives 

dx dy dz 

4. Thermodynamics. If p, v, and U are the pressure, volume, 
and internal energy of a gas enclosed in a receptacle, then they 
are connected by the equation 

(60-9) /(p, t;, U) == 0. 

Hence, the state of a gas is completely determined from (60-9) 
by specifying any two of the three quantities, say p and v, 
which can be regarded as representing the coordinates of a 
point P in the pt>-plane. If the state of the gas changes, the 
point P describes a curve C, and if the process is cyclic, the curve 
C will be a closed one. 

It is important to know the amount Q of heat lost or absorbed 
by the gas while the gas in the receptacle (for example, steam 
in an engine cylinder) changes its state. Let Ap, Av, and AU 
be the increments of pressure, volume, and energy when the 
amount AQ of heat is added. Then 

AQ = AU + pAv. 

If p and V are considered the independent variables, then U is 
determined from (60-9), giving U ^ U{p, v). Hence, approxi¬ 
mately. 


At7 = ^A2,+ 


dv 


Av. 


Therefore, except for infinitesimals of higher order. 
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As the state of the gas changes, p and v vary along a curve C 
in the pt>-plane, and it is clear that the total amount of heat 
introduced into the gas during this change is 

The integral (60-10) is obviously of the form 
j[jM{f,v)dv+N{v,v)dv]. 

If, during the expansion of the gas, there is no gain or loss of 
heat, then the process is called adiabatic. It is characterized 
by the equation dQ = 0. 

PROBLEM 

Show with the aid of (60-5) that the velocity potential $ satisfies 
the equation of Laplace, 
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INFINITE SERIES 


61. Infinite Series. Let Ui, Ui, %%,•••, w„, • • • be any 
sequence of quantities; then the symbol 
00 

(61-1) Wn S 4- W2 -j- Ws • • • -f M» + * • • 

n-l 

is called an infinite series. With the aid of the symbol (61-1) 
one can form a new sequence {s^ whose elements are sums of a 
finite number of the terms of the series (61-1): 

Si = Ml, 

Sj = Ml -f Ml, 

Ss = Ml Ml -f Mj, 


Sn = Wi -)- Ml + + ■ • • + M*, 


The numbers s< will be called the ith partied sums of the series 
(61-1). 

00 

Defiinition. An infinite series ]^m„ is said to converge if the 

sequerux of partied sums {sj} is convergent. A series which does 
not converge is called divergent. 

Stated in symbolic form this definition of the convergence 
of an infinite series is* 

(61-2) lim s„ = 5, or \S — s„| < e, for all n ^ p. 

The number S is frequently called the sum of the series (61-1), 
although one should clearly realize that it represents the limit 
of the partial sums s«. 

* See Sec. 3. 

209 
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A necessary and sufficient condition for convergence of any 
sequence was given in Sec. 6, and it will be restated here for 
easy reference. 

A necessary and sufficient condition for the convergence of 

00 

^ Un is that for any e > 0, one can find a 'positive integer p {depend'- 

n*"l 

ing on e) such that 

jSn 5,^1 € 

whenever n and m both exceed p. 

It is clear that the series cannot converge if its partial sums 
Sn are unbounded, that is, if \sn\ can be made greater than any 
preassigned positive number M. However, the boundedness 
of partial sums does not ensure the convergence, as can be seen 
from the simple example of the series 

1^1 + 1 ^ 1 + .... 

Here = 1, S 2 = 0, Ss = 1, ' * * , =1, « 2 n = 0, • • • , 

and the 8n are clearly bounded, but the sequence 

i, 0, 1, 0, 1, • - • 

does not converge. 

Infinite series possess some properties which follow directly 
from the definition of convergence and from the fundamental 
criterion of convergence of sequences: 

•0 

{A) The convergence or divergence of a series ^ Un. is not destroyed 

n — l 

hy adding to or sicbtracling from it a finite number of terms. 

This follows directly from the fundamental criterion. Let 
the series be convergent; then for any e > 0 one can find a posi¬ 
tive integer p such that for any pair of numbers m > p and 
n > p, 

l8„ — 8»| < €. 

This condition, certainly, remains unaltered by the addition (or 
subtraction) of a finite number of terms. To be sure, the sum of 
the series will be altered by the addition (or subtraction) 
of a finite number of terms, but the property of convergence will 



§61 


INFINITE SERIES 


211 


not be affected. Tbus, if the sum of the series ^is S, then 

n — l 

the addition of a finite number of terms at + a 2 +•••+ aj, 
will give for the sum of the new series /S» + ai + as + * • • + 0 *. 
A similar argument can be supplied if the series diverges. 


(B) The limit of the general term Un of the series is neces- 

n = l 

sarily zero if the series is convergent. 

For 

%ln ^ 8n Sn—Ij 

and if the series converges, then 

lim Sn S and lim Sn-i == S. 


Thus, 


lim Un = lim Sn — lim Sn^i = aS — >Sf = 0. 


‘ The condition enunciated is necessary but not sufficient, 
that is, a series may diverge even though lim t^n == 0. A classical 

n—»• 00 

example illustrating this case is the harmonic series 

‘+ 5 +I+ +S+ 

in which «» increases without limit as n increases, as will be 
shown next. 

Since 

1_ 1_ 1 .i.=i 

n + l'^n + 2'^ n + n ^ 2n 2’ 

it is possible, beginning with any term of the series, to add a 
definite nximber of terms and obtain a sum greater than 
Un = 2, 

Vs + H>y2; 

» = 4, 

3^+M + M + M>K; 

» = 8 , 

y + Ko + ' ' ■ + Ke > 
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Kt + Ms + • • * + M2 > M- 

Thus it is possible to group the terms of the harmonic series* 

i + M + (M + M) + (M + M + M + M)+ • • • 

in such a way that the sum of the terms in each parenthesis 
exceeds since the series 

1+M + M"I"M”I" ' ■ ■ 

is obviously divergent, the harmonic series is divergent also. 

00 

(C) Let the sum of the series ^ Un he S. If a new series is formed 

n-l 

by multiplying each term hy a constant k to form the series 

kux + hui 4“ * ‘ • + kun + * * * , 

then the sum of the latter series is kS. 

For, let 

Sn = Ui U2 ‘ • • "h Un 

and 

5 ; = kui + ku^ 4 - . • . JcUn] 

then 

~ kSn* 

Hence, 

lim s'n = k lim = kS. 

(D) Given the two convergent series 

+ ^2 + ' ’ * + 4" * 

and 

4" + + Vn + 

*The fact that the associative law holds unrestrictedly for series of 
positive terms follows from the fact that the partial sums of the series 

(1) (mi 4" 1*2 4* * • * +'Ur) + (wr+l + • • • + Uh) + * * * 

are subsequences of the partial sums of the series 

(2) “Ui + “Mi 4* 'Ua 4* * * * 4 + • * * 4 

Hence^ (1) and (2) will diverge or converge together. 
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Let the sum of the first series be U and that of the second he then 
the series 

(61-3) («i + «i) -t- {ui ± t/j) 4- • -1- (ti« ± t>„) -f 

has the sum U ± V. 

Let 

- til 4" '*42 + ■ • -f- Un, 

= -h 4- ■ • • -f 

then 

4 = ('Ml 4 Vl) 4" ('M2 4 ** 2 ) -I" * ' • -j- (tin 4 **n), 

but this is precisely the nth partial s um of the series (61-3), 
which can be designated by s". 

Then 

lim («„ 4 sO = lim s" 

n —►« 00 

or 

U ±V = ]im 


This result can be stated as follows: 

Convergent series may he added or subtracted term by term. It 
should be noted that this property has been established for a 
particular mode of addition. It will be seen below that the sum 
of the series may depend on the order in which the terms are 
added. 

62. Series of Positive Terms. This section will be concerned 
exclusively wdth series whose terms are nonnegative numbers. 
The property (-4) of the preceding section states that one can 
discard any finite number of terms without affecting the con¬ 
vergence of the series, so that the conclusions of this section, 
in regard to convergence, will also be applicable to any series 
containing a finite number of negative terms. 

Theorem 1. A series of positive terms is necessarily convergent if 
its partial sums are bounded. 

Since the terms of the series are positive, the partial sums 
will form a monotone-increasing sequence of numbers, that is,* 

Si ^ 82 S Sz ^ Sn ^ 

* The equality sign allows some terms to be zero. 
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and a bounded monotone sequence is necessarily convergent 
(see Sec. 6). 

<0 

Theorem 2. If is a convergent series of positive terms, 

n*! 

and {an} is any hounded sequence of positive numbers, then the 
00 

series ^ UnUn is convergent 

Since the numbers a„ are bounded, 

On < M. 


Then the nth partial sum of o„m» is less than Ms„, where s, 

eO 

is the nth partial sum of ^ Un, From Theorem 1 it follows that 

n — l 

o«ti„ is convergent, since its partial sums are bounded. 

n — l 

Example 1. Consider 


^ a" s a + 0 =^ + a* + ■ * ■ -i- -h ■ * * . 

n-l 

(а) If a ^ 1, s„ ^ n so that the partial sums are not boimded, 
and hence, the series diverges. • 

(б) If a < 1, the series is a convergent geometric series. For 
the sum of n terms of a geometric progression of ratio a is* 

_ a(l — a”) _ a 

«* 1 _ o 

Thus, 


Sn 


< 





‘ The sum of n terms of a geometrical progression of ratio r and whose 


first term is a is Sn 


a(l - r”) 


1 —f 
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SO that the partial sums are bounded. Consequently the series 
converges. In fact, lim s„ = 7 -^^—, since lim = 0 , if 

»—► 1 O n-* • 

ffl < 1. 

Exampk 2 . Consider 

J- -I. J_ 4- J_ 4. 4. 

l-2‘^2-3‘^3-4'^ ■'■n(7i + l) 

This series can be written as 

+ + ' + G-;rii)+ • • • • 

Hence, the nth partial sum is 


Sn = 1 - 


n + 1 


Thus, Sn is bounded, so that the series is convergent. 

to to 

Theorem 3 (Comparison Test). Let ^ and v„ he two aeries 

n=l n»l 

of positive terms, the first of which is known to he convergent and 
the second divergent 


(a) If the terms of a given series ^ an of positive terms are such 

n“l 

op 

that an ^ Un, for every n ^ m, then the series ^ an is convergent, 

n=“ 1 

00 

(&) If the terms of a given series ^ an of positive terms are such 


n»l 


that On ^ Vn, for every n'^ m, then the series On is divergent 




In order to establish part (a) of the theorem, assume* that 
the inequality an ^ Un is satisfied for every term of the series, 
so that m = 1, Denote the nth partial sum of the given series 

ce 00 

^ an by Sn, and that of the series ^ Un by Un- Then 


n*l 


n — l 


«»^ u. 


* This entails no loss of generality. See property (.4). Sec. 61. 
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Since the sequences {«„} and { U„] are monotone increasing and 

ao 

the series is convergent, it follows that 

n«»l 

s„ ^ lim Un — U. 

n~-> «o 

Thus, the sequence {s„} is bounded, and, therefore, the series 
» 

an is convergent. 

n»»l 

In order to prove the second part of the theorem, denote the 
00 

nth partial sum of by Fn,* then 

n»“l 

s„ ^ F». 

00 

But, by h 3 rpothesis is divergent, so that {F«} is an unbounded 

n"«l 

00 

sequence, and hence 2) diverges. 

n«-l 

This test was used essentially in establishing the divergence 
of the harmonic series in Sec 61. 

00 

Theorem 4 (Cauchy’s Root Test). If a given series ]^an of 
'positive terms is such that 

(а) r < 1, for every n ^ where r is independent of 

to 

n, then the series is convergent 

n — 1 

//, however, 

00 

(б) lifor every n m, then the series ^ an is divergent, 

n*"! 

There is no loss of generality in assuming that the inequalities 
(a) and (b) are satisfied for m ~ 1. It follows from (a) that 

an r^, 

so that no term of the given series exceeds the corresponding term 
of the geometric series 

4- ^2 ^ ^ yTI ^ 
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which is convergent, since r < 1. Thus, by Theorem 3, the 
given series converges. 

The truth of the assertion of the second part of the theorem 
follows from property (B) of Sec. 61. If \/^ ^ 1, the general 
term of the given series does not tend to zero, and hence, the 
series must diverge. 

CO 

Corollary. If the given series ^ an is such that 
lim \/^ = r < 1, 


then the series is convergent 

If 


lim > 1, 


then the series ^ an diverges. 

n*! 

Consider first the case when r < 1, and choose a positive 
number € so small that 


r+ € < 1. 

Then, for any suflSciently large n, the quantity can be 
made to differ from r by less than e, that is, 

r — € < < r H- €. 

But r + € = r' < 1, and it follows from Theorem 4 that the 
series converges. 

The proof of the case when r > 1 follows directly from property 
(B) of Sec. 61. 

Theorem 5 (d’Alembert’s Ratio Test*). If the terms of a series 

00 

^ an of positive terms satisfy, from some value of n onward, the 
inequality 

^ < 1 , 

an 


* Also known as Cauchy*s ratio test 
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where r is independent of n, then the given series is convergent. 
If, however, from and after some value of n 


On 


1. 


then the given series diverges. 
Let 


Then, 

(62-1) 


an 


r, 


(r < 1). 


^ rdn^ 


and the inequality may be assumed to be satisfied for all n ^ 1. 
Hence, 

df^l ^ Tdnf 

dn ^ Tdn — 1 , 

On—1 ^ rfln—2, 


di ^ Vdif 

Oj rdi. 


Forming the product of the left-hand members and the product 
of the right-hand members of these inequalities and dividing 
out common factors give 

On+i S. r“ai, (n = 1, 2, • • • ). 

Thus, the terms of the given series are less than or equal to the 
corresponding terms of the geometric series 

Oi(r -f- r* -f- • • • 4- r" -f- • • • ), 

which is convergent since r < 1. Hence, the given series is 
convergent by the comparison test. 

The proof of the second part of the theorem is left as an exer¬ 
cise for the reader. 

•0 

Corollary. If the given series ^ o* is swh that 

n«l 


lim = r < 

n-+ to On 


1 , 


then the given series converges. 
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Hm 1 , 

. . n ' 


then the series ^ an diverges. 


n-l 

The proof is identical with that of the corollary to Theorem 4 , 
^];ier 0 replaces v^- 

0>n 

In applying Theorems 4 and 5, to establish the convergence 


00 


of the series it is essential to note that and 


n»»l 


must be less than some fixed number r smaller than unity for 
all values from some n onward. For example, in the harmonic 
series 


»-l 



n=el 


each of the expressions 


Qn+i _ ri 
an n + 1 


and 



is always less than 1 , but the series V - diverges. The difficulty 

■**7 rt 
n-l 

here lies in the fact that no fixed number r, independent of n, can 
be assigned for which 


This ratio can be made to approach arbitrarily near unity, which 
is in violation of the requirement that 

^ ^ r < 1 . 
an 

In other words, must ultimately be less than some 

an 

fixed number r, which is smaller than unity. 
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In general, the ratio test is easier to apply than the root test, 
but the latter is more powerful. It will be seen from the example 
given below that the root test is capable of furnishing positive 
information when the ratio test fails. It may be remarked 
that the root test is always applicable when the ratio test is 
applicable.* 

The corollaries to Theorems 4 and 5 are of most frequent 
use in practical applications, but if the limits involved fail to 
exist, one may have to apply the theorems themselves. Thus, 
consider the series 

rjsin a\ + r^|sin 2a\ + • • • -[- r"|sin na\ + • • • ^ 

where a is an arbitrary constant. 

In this case 

Qn+i _ sin ( n + l)a 
an ~ r" sin na 
_ |sin (n + l)a 
sin na 

This ratio does not approach any limit. In factf 

[ sin (n + l)a | 
sin na 

may assume values greater than unity as n • oo. But the root 
test gives 


= '^r^jsin naj = r^^lsirTnoj r. 

Thus, if r < 1, the series converges, no matter what a is. It 
should be noted here that lim does not exist. 

n—► « 

As an example of the application of the corollaries to Theorems 
4 and 6, consider the series 

X + 2x^ + 3rc® 4* + nx^ + 

* For details, see K. Knopp, Theory and Application of Infinite Series, 
Sec. 36, English edition. 

t However, it is impossible to find an integer m such that for all 

sin (n + 1)«|. 

is greater than unity. 

sin na 



INFINITE SERIES 


221 


where x ^ 0. The test ratio is 


= Vl±1 4. iV 

On n a:» \ ^ n/*’ 

aad 

n—^ 00 dn ' 

Thus the series converges if 0 ^ a: < 1 and diverges if ar > 1. 
When a; = 1, the test fails, but the series 


1+2 + 3+ +?*• + 


is obviously divergent. 

The root test furnishes the same information, since 
•V^ = 

But* 


so that 


lim = 1, 

n~^ 00 


lim X — X, 


and if 0 X < 1, then the series is convergent. 
The series 


_ 4- JLL -1- 411. 4- 4- 4li 4- 

10 10 * 10 > 10 “ 

is readily shown to be divergent by the application of the ratio 
test. For 


lim = lim 


(n + 1)!10» 
n!10»+i 



n + 1 
10 


00. 


The ratio test, in the form given in the corollary to Theorem 
5, is very easy to apply, and if it fails in a given case, one may 
attempt to find a suitable comparison series and apply Theorem 3. 


n/-* 1 

* log V w “ log n, which tends to zero when n -♦ «. Hence 
n 


\/n e® as 1. 
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As an illustration of this circumstance, consider 

l+^ + A+ • • • +^+ • • ' • 

In this case the test ratio is 

ffln+i _ 


so that 

On (n + 1) 

Also, 

Um = 1. 

n—♦ 00 


= \l\’ so that lim = 1- 

Hence, neither of the tests given in the corollaries furnishes 
information regarding convergence. In this case, one may- 
resort to the comparison test. 

No-w consider the more general series, 

(62-2) l+^ + p+ +;^ + 

It will be shown that this series converges for every p > 1 and 
diverges whenever 0 < p 1. 

The terms of the series (62-2) may be grouped as follows: 

(62-3) 1 + (l? + ^) + (^ + ^ + ^ + ^) + 

+ 

where the fcth group contains 2*~‘ terms. The sum of the terms 
in each parenthesis is less than the number of terms in that 
parenthesis multiplied by the first term. Hence, the terms of 
the series 


(2*-x)j 


+ 


+ 




0 


+ 


(6M) l+2-i + 4-i+ ■ ■ ■ +2-^,+ • • . 

are not less than the corresponding terms of the series (62-3). 
But the series (62-4) is a geometric series of ratio gjri Hence, 
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if p > 1, the ratio is less than unity, so that (62-4), and therefore 
(62-2), will converge. 

It remains to establish the divergence of the series for p ^ 1. 
Note that p = 1 gives 

1+5+1+ +S+ 

which is known to be divergent. But the nth term of this series 
is not greater than the corresponding term of the series (62-2) if 
p < 1, since 



Hence, by the comparison test, the series (62-2) diverges for 

p < 1. 

The series (62-2) and the geometric series are frequently 
used as the standard comparison series. 

A similar argument can be used to establish the divergence 
of the series 


213^2 + 3T3i3 + + + 

Let the terms of the series be grouped as is indicated below: 


2 log 2 


Evidently, 


(3 log 3 4 log 4 ) (s log 5 + ■ ■ ■ 8 log s) 


+ 


(9I0, 


log 9 


+ 


16 log 16, 


:) 


+ 


1 , 1 . 2 11 
3 log 3 4 log 4 ^ 4 log 4 2 2 log 2 ’ 

1 1 . 4 _1 1 

5 log 5 8 log 8 8 log 8 3 2 log 2 ’ 

1 I , 1 8 _ 1 1 

9 log 9 "^16 log 16 16 log 16 4 2 log 2’ 


Therefore, the terms of the series 

ri^(' + 5 + 5+- + 5 + ) 
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are not greater than the corresponding terms of the given series, 
and the series (62-6) is obviously divergent. It follows that the 
series (62-5) is divergent. 

As a further illustration, let it be required to test the series 


rr2 + ri+ +(2rr-T)2n + 

Here, 

,. 0^4-1 ,. 1 (2n - 112n 

a„ " “?l(2n -f l)(2n + 2)' 1 

„ 4n2 “ 2n _ ^ 2n 

„^„4n* + 6n -f 2 ~ , 3 , X 


1 . 


Hence, the test fails, but if the given series be compared with the 
series (62-2), for p = 2, it is seen to be convergent. 


PROBLEMS 

1. Prove that 5 + J + ^ + ‘'‘ + ^+ ‘’‘ diverges. 

2. Prove that 1 ^ ‘ + 2 ™~j [ -!-••• diverges. 

3. Test the series 1 + ^ + ^ + • • • + ^ + • • • . 

4. Test the series 1 -f- -f- —h 

log2 log 3 logn 

6. Test for convergence: 


(a) 1 J-3^-1- - -1--1- 

2 ^ 2 • 2» ^ 3 ■ 2» ^ 4 • 2* ^ 

I ^ lx §XX + ■ ■ • 5 

+ | + | + 

(^1+2 + 3 4 

^ 2 2 ^ 2 ® 2 ^ 


Vs-3 


•v/ n(n + 1) 


6. Show that 1 + 


diverges. 
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7. Show that the series 1 + i + — + 

5 10 

convergent. 

00 

8. Show that converges. 


n ">2 


9. Show that ]Sv^ + ~ n») 

n — l 
00 

10. Show that ~ diverges. 

n«“l 

00 

11. Show that —7=-diverges. 

V ^ log n 

n-2 

00 

12. Show that converges, if a; > 0. 

n — l 
eo 

~ converges, if a; ^ 0. 


+i+fl+ " 


n»l 


14. Show that converges, if 0 a; < 1. 

n — l 
00 

16. Show that diverges^ if a; > 0. 


n — l 


63. More General Tests. The tests established in Sec. 62 are 
those most commonly used in practice. There are many more 
general criteria of convergence than those given in the preceding 
section, but their application is considerably more involved.* 

Some of the sharper criteria are discussed in this section. 

00 

Theorem 1 (Cauchy’s Integral Test). Let '^a„1>ea given series 

n — l 

of decreasing positive terms. If there exists a positive monotone 


♦ See, for example, Knopp, K., Theory and Application of Infinite Series. 
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decreasing function f(x) for a: ^ 1, such thcd f{n) — a„, tfien the 
given series converges if the integral 

f^y(x) dx 

exists; the given series diverges if the integral does not exist 

By hypothesis f(n) == an, therefore, the ?ith partial sum of the 
given series is 

n n 

S^= '^ai = 

.-1 »-i 

Let the values of f(i) be plotted as the ordinates (Fig. 66); 
then each term of the series can be interpreted as the area of a 



Fia. 66. 

rectangle of base unity and height /(i). Each of these rectangles 
extends above the curve y = f{x), so that the area of the sum of 
the n rectangles is greater than the area under the locus of y = f(x) 
bounded by the a;-axis, and the lines 1 = 1 and a: = n + 1. 
Ilius, 

(63-1) s, > dx. 

On the other hand, the sum of the areas of the inscribed rectangles, 

n+l 

Os -f- o» + • • • ■+■ a»+i = ^f(n), 

n-a 
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is less than the value of the integral dx, so that one 

can write 

dx. 

n*2 

But 

»+i 

]^/(n) = Sh-i - tti. 

n-*2 

Hence, the inequality just above can be written as 
(63-2) Sn+i < dx + ai. 

But the function y = f{x) is positive; hence 

dx < dx. 

If the integral on the right converges to a value L, then it follows 
from the inequality (63-2) that 

^n+l <C i -f- Ol. 

Thus, the partial sums are bounded, and by Theorem 1, See. 62, 

to 

the series ^a„ converges if the integral does. If, on the other 

n-l 

hand, the integral becomes infinite, it follows from the inequality 
(63-1) that the series diverges. 

It may be remarked that it is not necessary to demand that 
/(») be equal to CLn for all values of n beginning with « = 1. 
If m is any number, greater than unity, and if the condition 

fin) = a« is satisfied for n m, then the series ^ a» and the 

n-l 

integral lf(x) dx will converge and diverge together. 

tJfIt 

Example 1. Test the harmonic series 

'+5+5+ +;+ 
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Eerefix) = since/(w) = “ Now the integral 

-dx = log n 
1 ^ 

and 

f"l-.lim r^ = Umlogn=«, 

X n-->« t/ 1 ^ ®® 

so the given series is divergent. 

Example 2. Test 


2 + 5 + 10 + 


+ n* + l + 


Here 


and 


m 


1+ a:* 

r dx 

Jl 1 

lim (tan~^ n — tan“^ 1) = p 

•tl.—► 00 * 


, ^ = tan~^ n — tan”*^ 1, 

+ 


and, since the integral converges, the given series is convergent. 

The test of d'Alembert (Sec. 62) is merely a particular case 
of an extremely general test due to E. Kummer, from which a 
galaxy of important special tests can be deduced. 

Theorem 2 (Kummer’s Test). The series of positive terms 


^ Un is convergent if there exists a sequence of positive numbers, 


n«“l 


{an}, such that from some value of n onward, 


(63-3) 
However, if 
(63-4) 


an-; ■' - an+i ^ r > 0. 


Ufn ^ r\ 

a„- - a„+i 0, 

Un+1 


then the given scries diverges, provided that the series diverges. 


ft**! 


It may be assumed, without loss of generality, that (63-3) 
is satisfied forn 1. 
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Setting n = 1, 2, 3, 4, • • • , n — 1 in (63-3) gives, 

aiUi — a2U2 ^ ru2, 
a2U2 — azUz ^ ruzy 


ttn-lUn-l — a^Un ^ rUn. 

Adding these inequalities term by term gives 

(63-5) aiUi — anUn ^ r(sn — -Wi), 

where Sn is the sum of the first n terms of the given series. It 
follows from (63-5) that 


or 


rSn ^ diUi — anUn + TUiy 


Sn ^ - 

r r 

^ (ai + r)ui 
r 


Thus the sum of any number of terms of the given series is 

bounded ^since — is independent of n^, and, hence, the 

series converges by Theorem 1, Sec. 62. 

In order to establish the second part of the theorem, note 
that (63-4) gives 

aiUl ^ a2U2 ^ ^ (lnUn> 

Hence, 

Un ^ aiUi • —; 

an 

and 

n-l n-1 


By hypothesis, the series 


2^ 


diverges; consequently, the 


series also diverges. 

n — l 
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It will be observed that for a„ = 1, (n = 1, 2, 3, • • ■ ), the 

test of Kummer specializes to that of d’Alembert. * 

00 

If the series ^Un is such that lira = 1, the ratio test 

It —► OO Ufi 

n — 1 

fails. A test due to Gauss frequently enables one to determine 
the behavior of the series in this doubtful case. 


Theorem 3 (Gauss’ Test). If the series u„ of positive terms 

n-l 

is such that the ratio —^ can be written in the form 

Un+l 


Un 1,^1 

Mn+i n 

where A(n) is a bounded function of n as n-* cc, then the series 
converges if h > 1, and diverges if h ^ 1. 

The proof of this test follows from the test of Kummer. 
Consider first the case when h 1, and set o» in Kummer’s 
test equal to n. Then 


Urn (an— 

n-+ w \ Wn+l 




"(‘+5 + 


A(n) \ 
n^ ) 


— n — 1 


If A > 1, then ft — 1 = r > 0, and it follows from Kummer’s 
test that the given series is convergent. On the other hand, if 


ft — 1 < 0, the test of Kummer ensures divergence, since 



n-l 

is a divergent series. It remains to consider the case when ft = 1. 


Note that the series .. is divergent,! and set a, in 


n-l 


Kummer’s test equal to n log n. Then, 

“ ®«+i = ” log n — (n + 1) log (n. + 1) 


* See also Raabe’s test in Prob. 6, p. 233. 

t This fact can be readily established with the aid of the integral test of 
Cauchy; see also (62-6). 
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= «log n + log n + 


A{n) log n 


— (n + 1 ) log (n + 1 ) 
^ ^ n +• 1 ' n 

which tends to — 1 as n , since ^ ^ 0 , and 

(» + 1 ) log 5 ^ = -log [(l + 0 (l + i)] 

tends to — 1 as n increases indefinitely.* 

Example 1. Consider the series 

i+Li3 + L:AJ + 

^ 2 - 4 ^ 2 - 4 - 6 ^ 


_ 2 n + 2 
ttM-i ~ 2 n + 1 


^ 2 n 2n{2n + 1 )' 


Since ^ = 2 


75 J the series is divergent. 

4 +- 
n 


Example 2 . Consider the series 


1 • 3 • • • (2a - 1) 1 


2 1 • 3 • • • (2 
2.4... 


2n 2n + 1 


Un _ (2n + 2)(2n + 3) _ 4n* + 1Q« + 6 
~ (2n + 1)* 4 n* + 4n + 1 ‘ 

Dividing the numerator by the denominator gives 


14- — 

JbL.^1+1 _ 

Wti4-i 2ii- + 4tn + 1 


♦ See Sec, 10. 
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and since A = % and 


A{n) = - 




is bounded when »—»<», the series is convergent. 

PROBLEMS 

1. Test for convergence: 


<‘> 

n — 1 
«s 

2 («- 1)+«*’ 
n*! 

M 2 f 


n-1 


00 

^ * 3 • * * (2r^ - liy 

2. Discuss the convergence of ^I- 2 »4 » ' « '«~2 n -/ ’ 

n*«l 

where p > 2 and p ^ 2. 

-Ana. Convergent if p > 2; divergent if p 2. 

3. Discuss the convergence of 




1*3 ' 1-3-5 

4. Discuss the convergence of 


• Ans, Divergent. 


2 2.4... 
1 • 3 • • • (2i 


2n 


n-1 


(2w - 1) 2n + 2 


Ans. Divergent. 


5. Discuss the convergence of 


flO 

2 A-3 - • • (2n - 1) 4n + 3Y 
\ 2 • 4 • • • 2n ■ 2n + 2/ 

n-l 
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6. Deduce, with the aid of Kummer’s test, the following test due to 
Raabe: 


If lim ni -1) >1, then the series Un of positive terms 

convergent. 

If lim -11 <1, then the series of positive terms is 

n->« \Un+i / 

divergent. This test frequently settles the doubtful case when 


Urn ^ = 1. 

n—* oe ^n> 

64. Series of Arbitrary Terms. It follows from Property (C) 
of Sec. 61 that the theorems of Secs. 62 and 63 are applicable to 
series all of whose terms are negative. It will be assumed in 

oe 

this section that the terms of the series an are arbitrary real 

n«l 

numbers, and it will be seen that the behavior of such series is 
vastly different from that of series whose terms maintam the 
same sign. 

The following theorem, which is basic in all subsequent con¬ 
siderations, is a restatement of the theorem of Sec. 5 on sequences 
phrased in the language of infinite series. 

Theorem. A necessary and sufficient condition for the conver-- 

gence of a series an is that for any e > 0, one can find a positive 

n —1 

integer N, depending on e, such that 

|Sn+j> Snl ^ jc^n+l "f” Un+2 Ctri+pl €, 

forn ^ iV and every integer p ^ 1. 

It should be carefully noted that the meaning of the inequality 

|an+l + Un+a + + CLn+p\ < 6, 


is that the sum of any number of terms of the series ^ a», begin- 

n — l 

ning with Un+i, must remain less than a preassigned number 
€ > 0, so long as n ^ iV^. 



234 


ADVANCED CALCULUS 


The infinite series 


SM 


■ On+l + 0»+S + • • • + + 


X 

*“71 + 1 


obtained from the given series by discarding the first n terms, 
is called the remainder after n terms and is denoted by the symbol 


Thus, if the sum of the series is denoted by S, then 

jfe=»i 

Sn + rn = S, or S - Sn 

and it is clear that represents the error in approximating the 
sum S of the series by the sum Sn of n terms. The problem of 
calculating the actual value of the remainder rn (and, hence, 
that of the sum S of the series) is, in general, an exceedingly 
difficult one. However, in many instances it is possible to 
obtain an estimate of the magnitude of the remainder without 
determining its actual value. This is illustrated in the following 
theorem, which is due to Leibnitz. 

Theorem on Alternating Series. A series whose terms are 
altemately positive and negative and such that their absolute values 
form a monotone null sequence is convergent The absolute value 
of the remainder after n terms of such a series does not exceed the 
absolute value of the in + term. 

In order to prove the theorem, consider the partial sums 


and 


S2n = Ul —■ ^2 +. C3 — —* a2n 


52n+2 == Szn + Ct2n+2). 


By hypothesis the terms are monotone decreasing, so that the 
quantity in the parenthesis is positive. Hence, 


^ S2n; 

so that the partial sums of even orders form an increasing 
sequence. On the other hand, 

S2it = ctl ((I2 O3) (<Z 4 Cb) — • • • — (a2n —2 — Ct2n—l) — 02nj 

and, since the quantity in each parenthesis is positive, 
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This states that the increasing sequence { 82 „} is bounded, and 
hence, it must converge to some value S. But 


and 


S2»+l ~ Sin + 0,2n+l, 


lim S2n+i = lim S2„ + lim a2n+i- 

• n—> 00 « 


Siuce the terms of the given series form a null sequence, 


lim asn+i = 0i 
00 


SO that the partial sums of even and odd orders tend to the same 
limit S, 

It remains to show that 

\rn\ < |an+i|. 

Note that if is even, then 

Tn = fln+1 (ctn+2 Ctn+s) —* • • • 

If w is odd, then 

= ““Ctn+1 + 0,n+2 CLn+Z + * * • , 

so that 

(fl’n+2 C^n-j-s) (<^n+4 C^n+s) — • • • 

< dn+l. 

Thus, 

lr«l < lo»+il, 

which completes the proof of the theorem. 

This theorem enables one to establish easily the convergence 
of an alternating series, since all that is necessary to show is that 

(а) |an+i| < lunl, for all n ^ m, 

(б) lim = 0. 

n —>00 

Example 1. The series 

is convergent since |a«+i( < [onl for all n, and lim o« = 0. The 

n—+« 

remainder after 1000 terms, rio<ro < Mqoi> so that the conver¬ 
gence is very slow. 
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Example 2. The series 


5 

2 


Z . 9 _li+ . . . + (_i)»-i 2 !L +3 


+ • • • 


has lo^il < lo„| for all n, but it is divergent since lim a„ 0. 

* n“-> 00 

Example 3. The series + + • • • 

is alternating, and lim a„ = 0, but it is divergent. Why? 

00 


66. Absolute Convergence. The series ^ is said to converge 

absolutely if ^ \an\ is convergent The convergent series which 

do not converge absoltdely are called conditionally convergent 
series. 

The fact that a series may converge in the ordinary sense but 
fail to converge absolutely can be seen from the following simple 
example. It was just shown that the series 


is convergent, but the series of absolute values is the harmonic 
series 


1 _L. 1 _L 1'4.-i 4- . . . Z . 


) 


which is known to diverge. 

00 

Theorem. A series ^ an is convergent if the series of absolute 

n*l 


values ^ |a«| is convergent. 

n — l 

Since the given series is known to converge absolutely, one 
can find a positive number iV, such that 

lUn+l! + Ittn+sl + • • • •+• Ittn+pl < €, 

whenever n N, and for every positive integer p. But 

\an+l + CLn^2 -f * * * + <ln^p\ ^ + |a«+2| + * • ' + I®n4-D|; 
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|a»+i + ®n+2 + * ‘ • + a»+i>l < «> 

m 

•which is the criterion for convergence of the series a,. 

n*l 

oe 

Inasmuch as the series ^ |an| is a series of positive terms, the 

n“l 

tests developed in Secs. 62 and 63 can be used to establish the 
absolute convergence of a series ^a„. In particular, the tests 

n»l 

of Cauchy and d’Alembert can be phrased as follows: 

ee 

Root Test. If the terms of the series ^ an from some value 
of n onward satisfy the inequality 

^\an\ ^r <1, 
then the given series converges absolutely. 

«0 

Corollary. If lim = r < 1, then the series Va„ is 

n— 

absolutely convergent. 

ee 

Ratio Test. If the terms an of the series an, from some value 


of n onward, satisfy the inequality 


r <1, 


then the given series converges absolutely. 

Corollary. If lim = r < 1, then the series V a» is 
an 

n«»l 

absolutely convergent. 

It was shown above that a series may be convergent, but 
hot absolutely convergent. If, however, 

a 1 »t M £ 1, 
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then On does not tend to zero, so that the tests of Cauchy and 
d'Alembert can be used also to establish the divergence of alter¬ 
nating series. 

As an illustration, let it be required to determine the range of 
values of x for which the series 



+ (_l)n-l^ + 


is convergent. 

Now, tlie test ratio is, 


and hence. 


ttn+l 

an 


n + 1 

X”‘ 

n 


\x\ 


n 


lim — 1^1 


Therefore, the series converges for all la;| < 1 and diverges for 
all |a;[ > 1. When x = ±1 the test fails, but substituting 
X = 1 in the series gives 

1-K + M-K+• • • , 


which is convergent. Setting x = — 1 gives 


- 


which is divergent. Thus, the series converges whenever 
-l<x:Sl. 

Series that converge absolutely possess some remarkable 
properties that are not shared by conditionally convergent series. 
It will be shown in the next section that the sum of an absolutely 
convergent series is independent of the order in which the terms 
of the series are added, but that this is not the case if the series 
converges conditionally. In fact, by suitably rearranging the 
terms of a conditionally convergent series, the resulting series 
can be made to converge to any desired value, or even made to 
diverge. This striking behavior of conditionally convergent 
series is illustrated by an example, and the reader will have no 



INFINITE SERIES 


§66 


239 


diflaculty in constructing a general proof along the lines of the 
example. 

Consider the series 


111 f — 

(65-1) 1-- + ---+.. +L^ 


+ 


The fact that the sum of this series is less than. 1 and greater 
than }4, can be made evident by writing the series as* 


(1 - K) + (M - + (K - M) + • • • , 

which shows that s„ > 3^^ for «• > 2; on the other hand, the given 
series can be written as 


I - (}A-H) - (Vi-H) - ' • • , 

from which it is clear that s„ < 1 for « S 2. 

Now if the series 


(65-2) (1 — A ~ M) + (H ~ H ~ A) + (34 — Mo — M2) 

+ • • • 

is formed by an obvious rearrangement of the terms of (65-1) 
then the series (65-2) converges to only one-half the sum of the 
series (65-1). For, adding the first two terms in each parenthesis 
of (65-2) gives 

(M - K) + (M - M) + (Mo - K2) + • • • 

= MO- — M + M — M + H— 

It will be shown next that it is possible to rearrange the series 

1-M + M-M +• • • , 

so as to obtain a new series whose sum is equal to 1. The positive 
terms of this series in their original order are 

1, M, H, M, M,---. 

The negative terms are 

-M. -M, -Vo, -M, ■ ■■ . 

In order to form a series which converges to 1, first pick out, in 
order, as many positive terms as are needed to make their sum 
equal to or just greater than 1, then pick out just enough negative 


* It will be seen in Sec. 76 that the sum of this series is log* 2, 
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terms so that the sum of all terms so fax chosen will be just less 
than 1, then more positive terms until the sum is just greater 
than 1, etc. Thus the partial stuns will be 

Si = 1, 

s* = 1 — ^ = 

S4 = l — 3^ + Ji + M = 
ss=i-M + K + M- J4 = 

Sr=l — + + K + = ^®°K260> 

S8=1~K+M + M — M + K + M — K = ^°®M260, 


It is clear that the series formed by this method will have a sum 
equal to 1. 

66. Properties of Absolutely Convergent Series. 

Theorem 1 (Commutative Law of Addition for Series). The 

rearrangement of the order of the terms in an absolutely convergent 
series does not alter the sum of the series. 

The theorem will be established first for a series of positive 
terms. Let the series 

(66-1) Ui fls + + + Ctn + 

of positive terms be convergent to the sum S, and denote its 
nth partial sum by Sn- Suppose that the terms of the series 
(66-1) are rearranged in any way to give a series 

(66-2) h + h2 + h+ • — +b^+ • ■ ■ , 

and denote the mth partial sum of (66-2) by s'„. Inasmuch as 
every term of the series (66-2) appears somewhere in the series 
(66-1), and since (66^1) is convergent, it is possible to find a 
positive integer N such that Sn, for n > N, will contain all the 
terms appearing in si, and some others which do not appear in 
Then 

sf,<8n< S. 

It appears that the partial sums s'„ are bounded, and since 
the sequence {si,} is increasing, it must approach some limit, say 

(66-3) S' ^ S. 

It remains to demonstrate that S' and S are equal. This can 
be shown by reversing the point of view and regarding the series 
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(66-1) as some rearrangement of the series (66-2). It was just 
shown that (66-2) has a sum S', Therefore, for a sufficiently 
large m, s'„ will contain all the terms appearing in the partial 
sum Sn, Hence, 

Sn < si < S', 

and, since lim Sn = S, it follows that 
(66-4) 8 ^ S'. 

A comparison of (66-3) and (66-4) leads to the assertion that the 
inequality sign cannot hold, so that 

S' = S. 

Consider next an arbitrary absolutely convergent series 

00 

^Un, and denote its sum by S. Term the series 

n-1 

^ (|a«l + On) and ^ (|a„| - a„). 

n““l n»»l 

Each term of these series is positive or zero, and they are conver¬ 
gent since lo«l ± On ^ 2lo«l. Now the difference of these series is 

00 00 CO 

(66-5) ^ (junl + an) — = 2^an = 2>S. 

n=“l n“l n=»l 

Since both the series in the left-hand member of (66-5) are 
independent of the arrangement of the terms, their difference 
00 

22 ^ 0 . is likewise independent, and this establishes the theorem. 

n-l 

00 

Corollary 1. If is absolutely convergent, then any “sub- 

n“l 

series” farmed from it by deleting any number {finite or infinite) of 
terms is absolutely convergent. 

This follows directly from the foregoing since the partial 

sums of the subseries are boimded. 

00 

Corollary 2. If ^a„ is an absolutely convergent series, and if 

n-l 

Ml, Mi, * • • , Mn, is any sequence of quantities whose 
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nun&ncdl values do not increase indefinitely, then the series 
aiMi + aiMi + • * ' + aJUn + • • • 


is absolutely convergent. 

This follows upon the application of Theorem 2, Sec. 62. 
Example. Consider the series 

cos X cos 2x , cos 3a: 

“12 2“ "^ 3* 


This series is absolutely convergent for all values of x because the 
series 


1^ 

1^“ 


1 + i- 

2* ^ 3* 


is absolutely convergent and the numerical value of cos nx never 
exceeds unity. 

00 00 

Theorem 2. If u« avd «« are any two absolutely convergent 

n-1 n-l 

series whose sums are U and V, then they can be multiplied like 
finite sums to form the series 

(66-6) UiVi -f- UiVi -f- 02^1 -f- uiVi -J- U 2 V 2 -f* UiVi H" ■ ■ " 

-f* UiVn -+■ WaPn—1 -t- UnVi “b * • • , 

which converges absolutely and whose sum is UV. 

It is convenient to display the terms of the product series 
in the form of a rectangular array of numbers 


UiVi 

1 U1V2 

j UiVz 

. . 

. . UiVn 


> 





U2V2 

J U 2 Vz 

. . 

. , U 2 Vn 


/ 




UtVi 


U»Vt 

. . 

. . UzVn 




/ 

IWIlMnOstW* .... 


from which it is seen that the terms entering into (66-6) appear 
in the diagonals of the array followed from top to bottom. It 
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will suffice to show that any series formed from this array, in 
such a fashion that each term of the product appears once 
and only once in the series, is convergent absolutely. Any other 
series, and in particular (66-6), can be obtained from it by a 
rearrangement of terms. It is convenient to consider the series 
formed from the array by following the boundaries of the squares 
indicated by dotted lines, namely, the series, 

( 66 - 7 ) WiVi + U1V2 + U2V2 + + UiVz + u^Vz -f- UzH 

+ 'M3V2 + V>zVx 4- • • • -|- UiV^ -j- U^Vn + UzVn -f" ’ * ’ 

+ UnVn + WnVn-1 + * * * + UnVl 4" * * ' . 


It is assumed first that all terms in the series Un and 

n-l 

are positive. Let denote the mth partial sum of the series 
(66-7), and TJn and Tn the nth partial sums of the series 


n*»l 


and ^Vn, respectively. Then 

(66-8) C7„7„ ^ s.. :£ 

so long as ra* £ m ^ (n -f 1)*. But 

lim UnVn = lim U^Y,^x = UV, 

and it follows from (66-8) that 

lim s„ = UV. 


Next let the series ^ and ^ »» be any absolutely convergent 

n —1 n»l 

series and form the series of absolute values 


(66-9) 

n«“l n —1 

The product, of the type (66-6), of these series, 

I«iOii + -H l«iOsl + + ImsOiI + 
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is convergent, since each term of the series (66-9) is positive 
and it was shown that the product of such series is convergent. 
This establishes the absolute convergence of (66-6). 

As above, let «« be the with partial sum of the convergent 
series (66-7), some of whose terms may be negative, and denote 
the limit of s* as m —» «> by 8. Since 

lim Sm = 8 

n—^ 00 


is mdependent of the manner in which m 
values 


Then, 

(66-10) 

But, 

and 


P, 22, 32 , • - , n2, • 
lim Sn 2 = S. 


Sn^ — TInVnj 


00 , let m assume the 


(66-11) Km Sn* = lim UnVn = UV. 

n—4- 00 n —4 «o 


A comparison of (66-10). and (66-11) shows that the sum of the 
product series (66-7) is 

s = uv. 


The particular form (66-6) of the product of two series is 
called the 'product of Cauchy^ and it derives its particular impor¬ 
tance from a consideration of the products of the power series 
discussed in Chap. VIII. It may be remarked that the condition 
enunciated in Theorem 2 is sufficient, but by no means necessary. 
If the series are conditionally convergent, the product of the two 
series depends on the particular arrangement of the terms in the 

product series. However, it was shown by Abel that if the series 
00 00 

and ^ Vn are convergent and have for their sums U and F, 

n=»l . n = l 

then if the Cauchy product (66-6) is convergent, its sum is 
necessarily TJV. Mertens has shown that if one of the two 


convergent series and is convergent absolutely, then 

n-l 
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Cauchy’s product converges to UV. The proofs of these 
assertions of Abel and Mertens are omitted.* 

Example. The geometric series 

(66-12) S 

n *«0 

converges absolutely if |r| < 1, and its sum is /S == p 

Hence, the product of the series (66-12) by itself, namely, 

(1 + r + + • • • + r” -H • • . ) ^ 7*2 . . . 

+ + • • * ) ~ 1 + 2r -f 3r^ + * * • + + 

is convergent to 

PROBLEMS 


1. Prove that ^ sin na converges absolutely for all values of ot so 


long as \r\ < 1. 


2. Prove that (—1)" is absolutely convergent for all values 


of a. 

3. Show that the series 


(v5 Vu 

formed by rearranging the terms of the convergent series 

I -_I— 1. _ 1 —1_ . . . 

V2 Vs Vi 

is divergent. 

Hint: Note that the general term of the given series, 


v^ 

♦ See Knopp, K., Theory and Application of Infinite Series, English ed., 
p. 320. 
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is positive and greater than 

—i=-i' 

y/4n -y A 

4 . For what range of values of a; do the series given below converge 
^ibsolutdy: 


^ 1_ 

/to V2” \ VvVi 


® I ^ 

(a) ® - or + fit " ■ 


( 6 ) 


^ ■ 5! 

X* 


1-3 


3 -5 5 • 7 


(c) 2 2 • 2* 


3 • 2» 4 • 


+ 


(d) lOx - 10^* + - • • • ; 

sin X sin 3x , sin 5x__ _ j 

(e) - p-p- •+■ 5* 

6. Form the Cauchy products of the series (o) and (6) and the series 

(c) and (6) in Prob. 4. 

6. For what values of a? is tne senes 

^ 3 




X + 

absolutely convergent? 

7. For what values of x is the senes 


2x 


+ 


VjL.Y + lf-^Y 

2\x + 4/ ^ 3V + 4/ 


X + 4 

absolutely convergent? < x < 4. 

67- Double Series. Consider an infinite array of numbers 
Oil, (h 3 — ■ 


), arranged in the form of a table 


dll 

Ui2 

018 

Oi4 • 

d21 

022 

028 

024 • 

azi 

032 

O38 

O34 . 

dii 

042 

O48 

O44 . 


^n4 
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where the first subscript on Ot,- denotes the row, and the second, 
the column in which the element aij appears. 

One can form the sum of mn terms of the array, 

Thus, 

3 4 3 

^34=^]^ dii = ^ (a»l + 0*2 + diZ + CEii) 
t-iy-1 t=i 

= Ull + Ul2 + Ul3 + ai4 
+ a21 + a22 + U 23 + <^24 
+ a3i + a32 + dzz + U 34 . 

It may happen that 

lim Smn = Sy 

m—► « 
n—► « 

where m 00 and n - 00 independently of one another. In 
such a case the symbol 

is called a convergent double series. 

A reference to the preceding section shows that the study 

eo 00 

of the product of two series and can be reduced to 

n = l 

that of the study of a double series whose terms are 0 */ = UiVj\ 
68. Series of Functions. Uniform Convergence. The 
remainder of this chapter is concerned with the study of series 
whose terms are functions of a real variable x. A series of 
functions of x 

(68-1) Ui(x) + U 2 (x) “h + Wn(a;) + 

will be denoted by the s 5 mibol ^Un(x), and it wiU be assumed 

n“l 

that the functions Un{x) are defined in the interval (a, 6). 
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If a; in (68-1) is assigned some definite value xi, there results 

CO 

a series of constants which may converge. If the given 

n = l 

series is convergent for every value of x in the given interval 
(a, 6), then it is said to be convergent in the interval (a, &). 

A series convergent in (a, i>), defines a function of x 

n=*l 

in that interval, which will be denoted by the symbol S(x), 

00 

The sum Sn(x) of the first n terms of the series ^Un(x) is called 

the Tith partial sum of the series, and the statement that the 
series converges for a given value of x, say x = xi, means that 

(68-2) lim Sn(xi) = S{xi), 

The definition of convergence (68-2) can be stated more explicitly 
as follows: 

00 

Definition. The series ^ Un(x) is convergent for a given value of 

n«l 

X if for any e > 0 one can find a positive integer N such that for 
aU values of n N 

\S{x) ^ Sn(a:)l < 6. 

If the sum of the terms of the series ^'^n{x) beginning with 

n<«l 

w»+i(a;) be denoted by r„(a;), then 

U{x) = S{X) — S„(x) = Un^i(x) + Mn+sC®) + ’ * * , 
and the requirement that 

|/S(x) — s„(a;)| < e 


is equivalent to the statement that 
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Thus, the assertion that the series ^ Un(x) is convergent for a 

n = l 

given value ot x = Xi means that 

lim rn(xi) = 0. 

n-> 00 

It should be noted carefully that the definition of convergence 
just given is concerned with convergence at a given point x xi 
of the interval (a, b), so that the number N appearing in the 
definition depends not only on the magnitude of e, but also 
on the choice of the point x = xi in. the interval. To illustrate 
this important remark^ consider the series 

5: +T)(2a:T-1) "'■(21 + l)(3i + 1) 

+ + [(n --1), + «{». -FT) + 

in the interval 0 a; < 1. 

The nth term of this series can be written as 


[(n — l)x + l\{nx + 1) (n — l)x +1 nx + l' 
so that (68-3) can be written in the more convenient form 

(6M) (*-7iT) + (sTl-5?Tl)+-" 

1 _1 _ 

(n — l)x + 1 nx + 1 

It is clear from (68-4) that the sum s„(x) of n terms of (68-3) is 

. 1 _ 1 _ ~. 

WX + l Ttx 1 

Hence, 

lim Sn{x) = S(x) = lim —^-^-7 = 1, if x 9 ^ 0 . 

Thus, if « 0, 
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Now let it be required to detenQiue the ruagnitude of N, 
corresponding to a prescribed e, such that for all n ^ N 

|r„(a:)| < e. 

Since 

the condition lr„(x)l < e becomes 


Solving for n gives 
(68-5) 


— . 1 < «• 
nx + 1 



from which it is clear that N depends not only on e, but also 

99 

on the magnitude of x. Thus, if « = 0.01, (68-5) gives n > —: 

X 

and for x = 3^, iV can be chosen to be 199. If e = 0.01 but 
X =: }4:9 ^ must be at least 4 • (99) + 1 = 397. It is clear that 
if € is fixed and x is allowed to assume values nearer and nearer 
to zero, then the value of N must be chosen larger and larger. 

The series (68-3) converges for all values of z in the interval 
0 < a; ^ 1, but it is impossible to find a single number N which 
will satisfy the inequality (68-5) uniformly weU, that is, for every 
value of X in the interval (0, 1). However, there are series of 
functions of x for which it is possible to find one number N, 
which does not depend on the particular choice of x in the interval 
and thus depends on e alone. 

An example of such a series is 


I / nx^ (n — l)x^ N . 

Vl + 1 -t- (n - l)x) 

where x is assumed to lie in the interval 0 a; ^ 1. Obviously 


1 -\-nx’ 


Sn(x) = 
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and 


S(x) = lim Sn(x) = lira- 


nx^ 

1 + nx 


= ic. 


Consequently, 


r«(a;) = S{x) — Sn(cc) = x 


nx'^ 

1 + nx 1 + nx 


The requirement that rn{x) < € is, in this case, 


1 , < €. 

1 + 7VX 

Solving this inequality for n gives 
(68-7) n > 1 _ i. 

C X 

The inequality (68-7) shows that N again is a function of 
both € and x, but there is an important distinction in the char¬ 
acter of the inequalities (68-5) and (68-7). If € = 0.01 and 
X = 34? ^ > 100 — 2 = 98, so that N can be chosen to be equal 
to 99. If € = 0.01 and a; = then n > 100 — 4 = 96, and 
N may be any number greater than 96. If e = 0.01 and x = %, 
the least value of iV’ is 99. It is clear that N remains hounded, 
regardless of what value of x is chosen in the interval (0, 1), for 
N = 100 will satisfy the inequality (68-7) with € = 0.01 
uniformly weU for 0 ^ x ^ 1. 

Thus, it is seen that the reason for the difference in the behavior 
of the two series is that for the first of them N does not remain 
bounded (e fixed) when x is allowed to assume various values 

in the interval, whereas in the second case the choice of iV = - 

€ 

will serve uniformly well in the interval (0, 1). This leads to an 
important definition. 

. 00 

Definition of Uniform Convergence. The series '^Un(x), 

n = l 

defined in the interval (a, 6), is uniformly wnvergent in that interval 
if, for any € > 0, there exists a number N, independent of the value 
of X in (a, h), such that 

\S{x)^s.{x)\<e, 


for all values of N. 
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It should be noted carefully that the concept of uniform 
convergence is connected inescapably with the interval of con¬ 
vergence. The reader wiU profit greatly by proving that the 
series (68-3), which was shown to be nonuniforirdy convergent in 
the interval (0,1), is uniformly convergent hr the interval (-S^, 1). 
In the latter interval the function N{x) is bounded [see (68-5)], 
so that one can specify a siugle number N depending on e only 
and not on the particular choice of x in the interval (J^, 1). 

69. Geometric Interpretation of Uniform Convergence. A 
geometric interpretation of the uniform and nonuniform con¬ 



vergence of series may help to crystallize these important con¬ 
cepts. The graph of the partial sum s„(a;) of the convergent 
00 

series 8(x) = ^u„{x) may be called the nth approximation 

n«-l 

to the curve y — S(x). 

If the series is uniformly convergent, then the statement that 

(69-1) |r„(j;)| s |S(a;) - s„(a;)| < e, 

whenever N and for all values of x in (a, b), can be written 
as follows: 


S(X) — € < Sn(x) < S(X) + «. 

It foUows from these inequalities that the graphs of the approxi¬ 
mating functions y = s„(x) for sufficiently large values of n 
can be made to lie between the graphs of y = S(x) -j- e 
y = S(x) — € for all values of x in (a, b) (Kg. 67). 

In the case of a nonuniformly convergent series it is impossible 
to enclose the approximating curves in a band of width 2e about 
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the graph oi y S(x), To be sure, for any particular value of 
Xj say X = xi, the graph of y = s»(x) can be made to lie arbi¬ 
trarily near y = S(x) in the neighborhood of that point, so 
that the inequality 

\SiXi) - $n(Xi)\ < € 

is satisfied. 



In the specific examples of Sec. 68 the series (68-3) is of this 
second variety. The graph of jS(x) is a straight line 

y = S{x) = 1, if 0 < X ^ 1, 

and 

S(0) = 0. 


The approximating curves 

y = 5„(x) - 

^ ^ ^ nx + 1 


are shown for several values of n in Fig. 68. All of the approxi¬ 
mating curves pass through the origin and approach the line 
^ = 1 asymptotically. For any fixed value of x, say x = xi, 
in the interval (0, 1), it is possible to find a curve y = Snix) 
which will lie as close to y = £>(xi) as desired; but it is obvious 
that one cannot enclose the approximating curves in a band 
of width 2€ no matter how large a value of n is chosen, 
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The behavior of the series (68-6) is vastly different (see Pig. 
69). The graph of y = 8(x) is the straight line y = z, and 
the graphs of 


y = sjjc) 


nz^ 

1 vx 


for sufficiently large n can be made to lie entirely within the 
strip bounded by the lines y = x ± e. 



The reader will find it instructive to examine carefully the 
series 


(69-2) S{x) = 


for which 


1 -1-a:* 


(r 




+ 


+ 2^x^ 1+x^ 

3^z 


) 


(r 


2H 


+ 3V 1 + 2^x\ 


) 


+ 


s,(a;) = 


n‘x 


1 -f- n®** 


Hence, Six) = 0, which is a continuous function for all values 
of X. The graph of y = Six) is the entire x-axis, y = 0. The 
graphs oi y — Snix) for n = 3, 5, 10 are indicated in Pig. 70. 
The approximating curves have peaks in the neighborhood of 
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X = 0 which grow higher with increasing n. Since y = s«(a;) 
cannot be made to lie within the . strip bounded by the lines 
y = +€, it is clear that the convergence cannot be uniform. 
However, if the study of the series is confined to any interval 
which does not include x = 0, say 0 < 5 ^ x < 1, the series will 
be found to converge uniformly to the value = 0. 

This illustration shows that the sum S(x) of the series may 
very well be a continuous function even when the series represent¬ 



ing the function is not uniformly convergent. However, a 
discontinuous function cannot be represented by a uniformly 
convergent series of continuous functions in the neighborhood 
of the point of discontinuity (see Sec. 70). 

PROBLEMS 

1. Show that 
_1 _ 1 

x+1 (x + l)(x + 2) (x + n^l)(x + n) ’ 

for which Sn(x) = — ^ ; is uniformly convergent in the interval 
X -j- n 

0 ^ X ^ 3 
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2. Show that the convergence of 

1 + X -{■ + + *” + 

is not uniform in the interval (0, 1), but is uniform in the interval 

log £ + log (1 x) 

(0, M)- Prove that if |fn(«)! < €, then n > ■ - 

3, Show that 

(1 — s) + x(l — x) + x\l — a;) + • • • 

is not uniformly convergent in the interval 0 ^ x ^ 1. 

4 Discuss the nature of the convergence of the series 



nx 

r+ 




(n — l)x \ 

1 + (n - lyx^)’ 


71X 

for which Sn{x) , , ^ , Show that S{x) is continuous but that 

1 + nV 

convergence is not uniform in any interval containing the point x = 0. 

70. Properties of TJmfonnly Convergent Series. In formulat¬ 
ing the definition of uniform convergence, no assumption was 
made regarding the continuity of the terms of the series. It 
wiU be assumed in this section that the functions Un{x) entering 


in are continuous functions of x in some interval (a, i), 

n*=l 

It is clear that the partial sums Sn(x), being the sums of a finite 
number of continuous functions Wi(x), will be continuous. 
However, the sum ^(x) of an infinite series of continuous func¬ 
tions need not be continuous. This fact is evident from the 
discussion in the preceding section in connection with the series 
(68-3). The question naturally arises: Under what circum¬ 
stances will a series of continuous functions define a continuous 
function? An answer to this question is given by the following 
theorem: 

Theorem 1. Let 

Ui(x) + U^ix) + + Un(x) + 

be a series such that each Un{x) is a continuous function of x in 
the interval (a, b). If the series is uniformly cornergerd in (a, b), 
then the sum of the series is also a continuous function of x in 
(a, 6). 
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Denote the sum of the series by )Si(x); then it is required to 
show that* for any value of x, say x = a:i, in the interval (a, b), 

+ A) - ^f(xi)| < e, 

whenever |A| < 5. Now 

l>S(xi + A) — 5(xi)| = |[/S(xi + A) — s„(xi + A)] 

+ [s.(xi + A) - s„(xi)] + [s„(xi) - Six0]\. 

Since the absolute value of the sum is not greater than the sum of 
the absolute values, one can write 

(70-1) lS(xi -h A) - Sixi)\ ^ |S(xi -b A) - s„(xi + A)| 

+ |sn(a:i + A) - s„(xi)I -|- |s„(xi) — S(xi)|. 

oe 

But, by hypothesis, the given series ^Un{x) is uniformly con- 

n«l 

vergent, so that for any prescribed € > 0 one can find a number 
N such that 

(70-2) \sn(x) — S(x)\ < whenever n ^ N, 

and (70-2) must be satisfied for any value of x in the interval 
(a, 6). In particular, it must be true for a; = a;i and for x — xi + h, 
so that 


Is„(xi) - S(xi)| < I 
(70-3) , 

|sn(xi -|- A) — S{xi -b A)1 < g* 

Having chosen N so that the inequalities (70-3) are satisfied, 
choose a number 5 so small that for a fixed n N 

(70-4) ls„(xi -b A) - s»(xi)l < whenever |A| < 5. 

This is alwa 3 ra possible since s„(x) is a continuous fxmction. 
Substituting in the right-hand member of (70-1) gives 

|/S(xi -b A) — S(xi)| + 1 + 

* See Sec. 11. 


if |Al < 5. 
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But this is precisely the statement required for the proof of the 
theorem. 

It should be noted that the conditions of Theorem 1 are 
sufficient to ensure continuity. A nopuniformly convergent 
series may converge to a continuous function [see the series 
(69-2)]. 

Theorem 2. If a series of continuous functions 

Ui{x) -f- U2(x) -!-•••+ Un(x) 

converges uniformly to S(x) in a ^ x ^ h, then 

J^S{x) dx = dx -h dx + • ■ • +j‘^Un(x) dx 

where a ^ a ^ i and a ^ h. 

This theorem gives a sufficient condition for the integration 
of a series of functions term by term. 


By hypothesis the series ^u„(x) is uniformly convergent in 

71“ 1 

the interval (a, b) so that foY any e > 0, 

(70-5) |r„(a:)| = l)S(a:) — s»(a:)| < e, for n ^ N, 

and for every x in (a, 6). S{x) and s„(x) denote, as usual, the 
sum of the series and the nth partial sum. It follows from 
Theorem 1 that S(x) is continuous, and hence it is integrable in 
(a, b). Therefore, 

(70-6) ^ 

where a and /3 are any two values of x in (a, b). 

From (70-5) it is seen that 

J^V»(a;)| dx < e(^ — a) ^ «(6 — a), 

and, since 

\£rn{x) da:| ^ ^®|r„(a;)| dx, 

(70-6) gives 

(70-7) ^ ~ ^1 ^ ~ ™ ^ 
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The inequality (70-7) states that the difference between the 
integral of the sum of the series and the integral of any partial 
sum Sn(x) can be made arbitrarily small, provided that N. 
But 


dx = dx 

i=l 

n 

= dx, 

so that (70-7) becomes 




n 

J^S(x) dx — dx 




< €(6 - a), 


for 


This inequality, however, states that 


n ^ N. 


(70-8) 

If the limit in (70-8) is set equal to x, where a ^ x 
then the series of integrals 

J\i(x) dx -f- dx + • ' * dx + • ^ • 

converges uniformly to 

fy(x) dx. 

A nonuniformly convergent series, when integrated term 
by term, may or may not converge to the integral of the function 
defined by the series. For example, the series (68-3) was shown 
to be non unif ormly convergent in the interval 0 :§ a; 1. But 

£s(.x)dx = £idx = i. 

The nth partial sum of (68-3) was found to be 


«»(®) = 1- 

^ ' nx + 1 



260 


ADVANCED CALCULVS 


§70 


and 

Jo " Jo (^~ 

= 1 - log (n + 1) 

n 

Hence, 

lim r\„(a:) d* = Urn (l - l5ii!L±i)'\ = i, 
n-^oo Jo n-^ce \ n / 

so that in this case 


J^^S(x) dx = '^f^Unix) dx = 1, 

n*“l 

despite the fact that the given series does not converge uni¬ 
formly. It is evident from this example that the condition 
enunciated in Theorem 2 is sufficient, but not necessary, for 
integration term by term. 

As an example of a nonuniformly convergent series that 

ee 

cannot be integrated term by term, consider the series ^ Un{x) 

n~l 

in the interval 0 « :S 1 whose nth partial sum Sn{x) is given 

by the formula 

Sn{x) = 

In this case the sum S{x) of the series is 

S{x) = lim na:e“"*’ = 0. 

n— 

Consequently, 

£s(.x)dx = 0, 

whereas 
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n*l 


The fact that the series ^Un{x)j whose nth partial sum is 

n*l 

Snix) — cannot be uniformly convergent can be seen 



Fig. 71. 

from the graphs of the partial sums y == Sn(x) plotted for several 
values of n in Fig. 71. The peaks of the approximating curves 
y = grow higher and higher* with the increase in n, and 
since S(x) = 0, it is obvious that it is impossible to draw a 
band of width 2€ about S{x) that will enclose all the approxi¬ 
mating curves y = Sn{x) from some value of n onward. 

Theorem 3. If the series 

uiix) + U2(x) + • • • + Unix) 4 - • • • 


♦ The reader will have no difficulty in showing that the ma x imum value of 


— SO that 

V2n 



Sn(aj) occurs when a? 
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is convergent to S{x) in (a, b), end if the derivative of each Un(x) 
is continuous in (o, 6) and the series of derivatives 

uiix) + u'i(x) + • ' • + + • ■ ■ 

is uniformly convergent in {a, b), then the series of derivatives 
converges to S'ix). 

Denote the sum of the series of derivatives by f(x). Then, 
since the series of derivatives is assumed to be uniformly con¬ 
vergent in (a, 6), Theorem 2 permits this series to be integrated 
term by term so that 

06 00 

fy(x) dx = l^X<{x) dx = X£<ix) dx 
00 

where a and x are in the interval (o, b). Hence, 

'But f(x) is a continuous function, and therefore,* 

f(x) = S'{x). 

This theorem provides only sufficient conditions for the 
differentiation of a series term by term. It is possible to prove 
the theorem under less severe restrictions. In particular, the 
requirement that the ul{x) be continuous is more severe than 
it need be.f 

71. Weierstrass Test for XJnifonn Convergence, The impor¬ 
tance of the concept of uniform convergence is amply illustrated 
by the theorems of the preceding section, and it is natural to 
inquire under what circumstances a given series converges 
uniformly. A direct application of the definition of uniform 
convergence, leading to the determination of the functional 
dependence of N upon x and e, is likely to be exceedingly difficult, 
since it requires knowledge of the expression for the remainder 
of the series. There are numerous tests, of varying degrees 

* See Sec. 38. 

t See Knopp, K., Theory and Application of Infinite Series, p. 342. 
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of complexity, but the simplest of these is the test due to K. 
Weierstrass, which is commonly known as the W&ierstrass 
M-test. 

Theorem (Weierstrass Test). Let 

Ui(z) + Ut{x) + + u„(x) + 

be a series of functions such that each Ui(x) is a bounded function 
of X in {a, b). If there exists a convergent series of 'positive constants 

Ml + Mi + ■ ‘ • + Mn + ■ ' * 

such that |iti(a:)l ^ Mi for all values of x in (a, b), then the series 

ui{x) + Ui{x) + • • • + Un{x) + • • . 

is uniformly and absolutely convergent in (a, b). 

In order to establish the theorem note that the series of M’s 
is convergent, so that 

Mn+l + Mn+2 + + Mn+p < € 

whenever n ^ N, and for aU positive integers p. But each 
Ui(_x) is such that lM<(a:)l ^ Mi for all values of a: in (a, b); hence, 

(71-1) |«,H-i(a:)| + |Mn+ 2 (a:)i +•••-{. |M„+p(a;)| < e. 

Since (71-1) is independent of the value of a; in the interval 

so 

(a, 6), the series ^Ui(x) is uniformly and absolutely convergent. 

It should be noted that the concepts of uniform and absolute 
convergence are entirely distinct and that they do not imply 
one another. The series may be uniformly convergent, but 
not absolutely convergent, and vice versa. 

Examples. Consider the series 

sin a: , sin 2a; , , sin no; , 

p 22 

Since |sm 7ix\ ^ 1, the convergent series 

A -j. JL + A 

will serve as an Jlf series for the given series. Therefore, the 
given series converges uniformly in any interval (a, 6), however 
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large. From Theorem 1, Sec. 70, it follows that the series 
00 

sin nx 


2i 


n‘ 


defines a continuous function S{x). Such a series 


n—1 

may be integrated term by term in any interval to obtain the 
integral of S{x), But the series of derivatives 


cos X , cos 2x , 
—+ — + 


+ 


cos nx 
n 


+ 


is not uniformly convergent. In fact,* it is not even convergent 
for X = 2kTc, where = 0, 1, 2, • * • . 

On the other hand, the series 


^i(^) = 2 


si n nx 
ri^ 


n«l 


upon differentiation term by term gives 


- 2^“ 

n-l 

The latter series is obviously uniformly convergent so that the 
differentiation is legitimate and one is assured that 

Ux) = ;SI(a:). 

72. Abel’s Test for Uniform Convergence. The test of Weier- 
strass possesses the advantage of great simplicity, but it is 
applicable only to a restricted class of uniformly convergent 
series, since every series to which the Weierstrass test is appli¬ 
cable is necessarily absolutely convergent. A more delicate 
test, essentially due to Abel, is of great practical and theoretical 
importance, especially in the study of power series. 

00 

Theorem (Abel’s Test). The series of functions con- 

n»l 

verges uniformly in the interval a ^ x b if the functions u„(x) are 

* This series, however, converges to —log ^2 sin. f) in the interval 0 <x <t. 
See Prob, 6, Sec. 105, 
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of the form Unix) = Onfnix), where the constants On are suck that 
00 

the series ^ is convergent and the functions fn{x) are hounded 

n = l 

and 'positive and satisfy the condition* 

fn+l(x) S fnix) < M, 

for every n and every value of x in (a, 5). 

Let 

Sn = 0^1 + ^2 + ‘ * • + an, 

== Sn+p — 5n = an+1 + an+2 + * * * + Cbn+py 

and 


Sn+p Sn Un+1 ”|“ ^n4-2 “f" * * * *4“ — an+l/n-f-l “f" ^n+2fn-+2 

+ * * • + an+pfn+p- 

Noting that 

1 ^n-i-my if 771 ^ 1, 


Si — an-i-i, 


one can write 


[>Sn-|-p Sn\ {an-j-ifn+l "4“ ^n-{-2fn+2 “f“ * * * *4” ^n-^pfn+pl 

= Wlfn+1 + (S2 — sD/n+2 + ' ’ ’ + (Sp ““ 4“l)/»H-p| 

= kl(/n+l —/n+ 2 ) + S2(/rt+2 ^/n+s) + * ' * + «^n+pl 
^ klK/n+l—/n+2) + |52|(/n+2“'/n+3)+ ‘ * ' +|41/n+P- 


Denote the greatest of the numbers [s^j, (m = 1, 2, • • • , p), 
by k; then 


(72-1) \Sn+p-Sr. 


^[(/«+l ■” fn+ 2 ) + (fn +2 — /n+ 3 ) + * • * 

/n+p] = ft/n+l- 


The series of constants is convergent; hence, for any 

n — l 

€ > 0 one can find a positive integer N such that for all n > iV 
and for every positive integer m, 

|Sn+m 5n| == 

* The proof goes through with obvious minor changes if the sequence of 
positive functions fn(x) is monotone increasing with n. 
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In particular, the inequality is true for the greatest of the 
and it follows that 


Substituting this value of k in (72-1) and recalling that |/n+il < M, 
gives 

1/Sn+p - Sn\ < for all N. 


But N is independent of Xj and therefore, '^Unix) is uniformly 

n»l 

convergent. 

PROBLEMS 

1. Test the following series for uniform convergence: 


(a) 1 + a; cos a + cos 2a + cos Sac + 
(fi) lOx + 10^^ + lov + *■•; 

sin 5a; ^ ^ ^ ^ 

■ "T * * * » 


, , sin a; , sin 3a: 

(c) — + 


32 


52 


(d) cos 2a: — ~ cos 3a: + ^ COS 4a: — • • * ; 
2 * 3 ® 4 "^ 

, . cos 2a: , cos 4a; cos 6a: 


■ X + *=“-*’ + 


is) 1 

X® X® X* 

w X - - + 3 - J + 
X^ x^ 

® l + x + ^ + ^ + - 


2. Test the series of derivatives of Prob. 1 for uniform convergence. 



CHAPTER VIII 
POWER SERIES 


73. Power Series. The series of the form 

ee 

= Oo + aix + + • • • + + * • • , 

n=0 

in which the coefficients of the powers of x are independent of 
X, occupy an especially prominent place in analysis and are known 
as power series. The totality of values of x for which a power 
series is convergent is called interval of convergence of the 
series. 

It is readily verified, with the aid of the ratio test, that the 
series 


1 + X + x^ + •• • + x^ + • “ • 

converges for all values of x such that lx| < 1, and diverges 
whenever |i;| >1, while the series 

fpn 

■ i + ^+i+'-+h+‘” 

converges for every real value of x. 

Obviously every power series converges for x = 0, whatever 
the coefficients a„ are. The fact that some power series may 
not converge for any value of x other than zero can be seen 
from a consideration of the series 


1 + X + 2lx^ + * • ' + nl x^ + • • * , 

/ 

The ratio of the (n + l)st to the nth term of this series is 


Un 


nl x^ _ 
(n - l) !x»-i ~ 


and since \nx\ increases with n for every x ^ % the series diverges 
whenever [xl > 0. 
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The folio-wing fundamental theorem, due to Abel, furnishes 
information concerning the character of the convergence of 
power series. 

00 

Theorem. If a power series 2)a„a:" is convergent for z = a:o, 

n**0 

then, it is absolutely convergent for every value of x such that 
\x\ < la:o|. On the other hand, if the series is divergent for x = * 0 , 
then it is divergent for every x such that \x\ > la:o|. 


Consider first a series which converges for some value 

of X, say X = xa. Then, necessarily, a„a;5^0 when n-> co, 
so that there exists a positive number M such that 

|a„a:j| < M, for n ^ 0. 


But 


»C0 

and, for any x such that \x\ < [irol, 

— = r < 1. 
Xo 


<M\ 


X 


Fo| 


n 

; 


Accordingly, the series of absolute values, 


s |oo| + loia:| + |a2a:*| + • • • + lo,va;"| + 

n*»0 

is term by term less than the Convergent geometric series 
M + Mr + Mr^ + • • • + Mr^ + “ • * , 

00 

and hence, the given series ^ a„a:“ converges absolutely. 

n-O 

The proof of the second part of the theorem follows from 
the first part. For, assume that the given series diverges 
for X = xa, and suppose that it converges for some value of x 
such that |x| > |a;oi. Then, by the first part of the theorem, 
the series must converge for » = aso as well, which contradicts 
the hypothesis. 
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It is possible to establish, with the aid of this theorem, the 

eo 

existence of a number R suck that ^ anX^ converges absolutely 

for every x such that \x\ < B and diverges for all x such that 
\x\ > R, However, instead of merely establishing the existence 
of Rj the actual determination of the value of R will be given 
in the next section, (This determination, of course, establishes 
the existence of i2.) The number R is known as the radius of 
convergence of the series* and the interval { — R,R) is called the 
interval of convergence. 

74. Interval of Convergence. The theorem to be established 
in this section gives the exact determination of the radius of 

convergence of the power series It follows from the 

n = 0 

application of the root criterion of Cauchy, f that if 
(74-1) ^\an\\x\ < r < 1, 


then the series ^ OnX^ converges absolutely for all values of x 

n = 0 

satisfying the inequality (74-1). In particular, if the limit of 

V^lunl exists as ti —> , and if its magnitude is L, then the series 
00 

will converge for every x such that 

n = 0 

(74-2) L\x\ < 1, 

and it will diverge whenever 
(74r3) L\z\ > 1. 


It follows from (74-2) and (74-3) that the radius of convergence 
22 is given by the formula 


(74-4) 


7? = 1 = 1 

L lim ^\aj( 


* The reason for associating with the number R the term radius of con¬ 
vergence is that the region of convergence of a power series where a; is a com¬ 
plex number is a circle of radius R. 
t See Sec. 62. 
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provided that L 9 ^ 0 . But if i — 0, the inequality (74-2) is 
satisfied for all finite values of x, so that in this ease the interval 
of convergence is infinite. If L = «, it follows from (74-3) 
that the series diverges for any x 9 ^ 0. Thus, if it is agreed, 

for the purposes of this section, to write ^ ~ 

then the formula (74-4) will be applicable to all those series for 
which the limit L can be determined. 

As an illustration of the application of formula (74-4), consider 


the series 


(a) X + x^ + + 

-f a;2n+l 

and 


Q>) 1 + (1) + (1) + 

2n 

+ U1 + 


Since o„ = 1 in (a), lim = 1, and the formula (74-4) 

n~+ 00 

gives B = 1. In the case of the series (b), ajn = so that 
lim Consequently, the radius of convergence of 

n—♦ oa 

(6) is 2. 

If one adds the series (a) and (6), there results the series 
(c) +a=* + (w) + 

which certainly converges for all values of x such that Ir] < 1. 
However, the l im it of as n 00 does not exist, since 

lim ^|osn| = H “id lini*"^lojn+i! = 1. Formula (74-4) is 

n—*^ « n—► 

not applicable in such a case, but it is recalled that every sequence 
of munbers has a uniquely defined upper limit, and it will be 
shown next that a generalization of formula (74-4) enables 
one to calculate the radius of convergence whenever (74-4) 
is not applicable. 

Theorem. I/ct L ^^Inote the upper limit of ffie sequence 


N. vW, 


.•v^H 
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then the radius of convergence R of the series ^ is given hy 
the formula 


n«0 


^ L lim '^\an\ 

Consider first the case where L = 0, so that R 
is any fixed number not equal to zero, then 


00, If a; 


2N 


> 0 . 


Since the upper limit L is zero, there are at most a finite number 
of the ^\an\ that are greater than!/ + e = 2 ^'* Consequently, 
one can find a positive integer p such that, for every n > p, 

or 

Thus, the absolute values of the terms of the series ^ UnX" 

n=0 

(for n > p) are less than the corresponding terms of the geometric 
00 

^ and, since x can be chosen arbitrarily large, it follows 


senes 


n*0 


that the given series converges for all values of x. 

Consider next the case when L is finite but not equal to zero, 
and let x be any fixed number such that 

lx|<i- 

Choose any number r between \x\ and that is, 

jx] < r < 


♦ See Sec, 7. 
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then, ->L, so that i = L + «. Since only a finite number 

of the can exceed L + «, it follows that there must exist 

a positive integer p such that for every n '> p 

^\an\ < 7 


or 


Thus, 


|a„a:" < -1^ < 1. 


Again, the general term of the series a„a:“ (for n > p) is less 

n**0 

in absolute value than the corresponding term of the convergent 


geometric series ^ Consequently the given series must 

n«0 

converge absolutely for every value of x satisfying the inequality 
la:| < r. Since r can be chosen as near i as desired, the given 
series will converge for every x such that 

N<J. 


A similar argument shows that if \x\> ji then |onX"| > 1, 
so that the series cannot converge for any x such that 



In the last possible case, namely, L = oo, the terms of the 
given series are unbounded if a; 0. Consequently, the only 
value of X for which such a series converges is a: = 0. 

In practice it is much easier to determine the radius of con¬ 
vergence with the aid of d'Alembert’s test. If the limit as 

n -♦ 00 of the ratio —- ^ is defined, then it follows from d’Alem- 
On 
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berths test that the series 
of X for which 


^ anX^ will converge for those values 

n=0 


lim |xl < 1. 


Therefore, the given series ^ anic” will converge whenever 


n»0 


la:l < 


lim 

n —* 00 


Un+l 


and it will diverge when 


> 


lim 

n-^ » 


an 


This permits the formulation of the following practical rule for 
the determination of the interval of convergence: 


Rule. If the series ^ anX^ is such that 


n=0 


lim = JK, 

n~»-oo 

then the series converges in the interval — JB < x < R, 

The discussion given above can be extended immediately 
to cover series in powers of a; — Xo, namely, 


(74-5) — * 0 )”. 

n—0 

The substitution x' = x — xo ia (74-5) gives the power series 

ee 

n—0 

nnH if the latter series converges for all values of sf such that 
Ix'l < r, then the series (74-6) will converge for all values of x 
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such that \x - a;ol < r. Thus, the interval of convergence 
of the series (74-5) has the point x = as its midpoint. 
Examples. The interval of convergence of the series 


l-fa;-!-Jj + 


+ - + 


is infinite since 

lim = lim = lim (n -|- 1) = oo. 

n —► 00 fi —> M 'W'« n-"*- 00 

On the other hand, lim does not exist for the series 

n—> 00 <Xn+l 

1 + a: + (l) + ** + (l) + • • ■ • 

However, the sequence 

inii, vw, -v^,..., -s/m,. .. 

is, for this series, 

1 ; , 

and it is clear that lim v^|an| = 1. Hence, the interval of 
convergence is — 1 < x < 1. 


PROBLEMS 

Determine the interval of convergence for the following series, and 
determine the behavior of the series at the end points of the intervals: 


(6) 10a? + lO^a?* + + • * 

(c) 1 + a? cos 0 + a;* cos 26 + 
{d) x + 2]x^ + 3b» + • • • ; 


(e) 1 + ma? + 


m(m — 1)_, , m{m — l)(m —• 2) 
a? “T ^ ■ - 


f~ _L 1 I 1 

^*■^2 3^2 


21 

•3a:» 


31 


X* -f- 


^>-2-3^ + 
(A) 1 - 2x -h 3*» 


4 6 ' 
a;* _ 
'5-6 
4a:* + ■ 
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(i) 1 + 



2 

+ 


5^ 


53 


(i) - + + 

a a® a* 


75. Properties of Ftmctions Defined by Power Series, The 

PO 

power series ^ anX^, whose radius of convergence is Rj converges 

n»0 

for every value of x such that \x\ < R and, hence, defines a 
function of x in the interior of the interval (—iJ, R). What 
can be said about the properties of functions defined by power 


-R -jco CL 0 ^ b Xq it 

Fig. 72. 

series? Will such functions be continuous? Is it permissible 
to integrate and differentiate power series term by term? And 
if so, what can be said about the intervals of convergence of the 
resulting series? The answers to these questions furnish an 
explanation of the prominent role that power series play in 
analysis. 

Theorem 1. Lei R > 0 be the radius of convergence of a j)ower 
00 

series ^anX^; then this series converges absolutely and uniformly 
«»=o 

for every value of x in any interval a < x ^ b which is interior 
to the interval {—R,R). 

Inasmuch as the interval (a, b) is assumed to lie entirely 
within the interval (—B, B), one can choose a positive number xo 
that is greater than \a\ and 16| but less than R (Fig. 72). Hence, 
the interval (a, 6) lies entirely within the interval (—Xo, ajo), 
so that for any value of a; in the interval (a, 6) 

lana:^l < ldnXj|. 

Accordingly, the series of positive constants 


n-sQ 
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can be used as the Weierstrass If-series to establish the absolute 

00 

and uniform convergence of the series ^ Ona:” in the interval 
(a, h). 

00 

Theorem 2. A power series ^ defines a continuous function 

n «=0 

for all values of x in any closed interval {a, h) which lies entirely 
within the interval of convergence of the given series. 

The truth of this statement follows from the preceding theorem 
upon recalling Theorem 1, Sec. 70. 

Theorem 3. If the radius of convergence of the series ^ anX^ is 

' n *«0 

00 

R, then the radii of convergence of the series nanX"^^^ and 

n = 0 


an 




^n4* r 


obtained hy differentiating and integrating the given 


series term by temiy are also R. 

The proof of the theorem follows from the observation that 

IS V'Tno^ = Hm , =Timv''|^, 

\n "y* JL 


since both n and tend to unity as n increases indefi¬ 

nitely. 

Theorem 4. A power series ^anX^ may be differentiated and 

n*»0 

integrated term by term in any closed interval (a, b) which lies 
entirely within the interval of convergence of the given series. 

The validity of this theorem follows at once from Theorems 1 
and 3 of this section, upon noting Theorems 2 and 3, Sec. 70. 

76. Abel’s Theorem. None of the preceding theorems of this 
chapter furnishes information concerning the behavior of a 
power series at the end points of its interval of convergence. 

Tor example, the series 

(76-1) /Si(x) = 1 -f- a: + a;* + • • • + + • • • 
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converges for every value of x interior to the interval (-1, +1) 
and diverges at a: = +1. 

The series 

(76-2) ;S2(a:) + ■••+-+•• • 

^6 n 

has the same interval of convergence as (76-1), but it converges 
Sit X = —1 and diverges when x = 1, 

The series obtained by differentiating (76-2) term by term 
is precisely the series (76-1), and the differentiation is legitimate 
so long as x lies in the interior of the interval (—1, 1). The 
series (76-1) defines a continuous function 




1 — X 


for every value of x such that |a:l < 1. 
Smce 


r*_j_ 

Jo 1 - 


dx = — log (1 — x) 


and 


J'^ (1 + X + x^ + ■ • • ■ ■ • ) dx = X + ^ + 


+ ^ + 


one can assert that 


S 2 {x) = — log (1 — x) 

so long as la;] < 1. 

It is important to note that the series (76-1) represents the 
function 


S^(x) = 



X 


only for those values of x which are interior to the interval (—1,1), 
and it is not surprising that the equation 


1 — X 

gives a nonsensical result, if one substitutes in it formally x == — 1. 
On the other hand, the series (76-2) converges not only for every 



278 


ADVANCED CALCULUS 


§76 


value of X interior to the interval (—1, +1)? but for x = —1 as 
well. In the interior of the interval (—1, +1) the series con¬ 
verges to 

(76-3) Si{x) = - log (1 - x), 

and the question arises whether formula (76-3) is valid for 
X = —1, so that one is permitted to write 

Sii—l) = —1 + ^ — ■ ■ ■ = — log 2. 

A theorem, due to Abel, which will be established next, answers 
this question in the affirmative. 

00 

AbePs Theorem. If a power series whose radius of 

n-O 

convergence R is finite, converges at x = R (or x —R) then it 
converges uniformly in the closed interval (0, R) (or (0, — J?)). 

There is no loss of generaKty in assuming that the radius 
of convergence of the given series is unity. For, a substitution of 
00 

X = By in the series whose radius of convergence is B, 

n“0 

produces the series 


«-0 

where 6„ = JK*a», and the series converges in the interval 

n=0 

(- 1 , 1 ). 

Assume that i = 1 is an end point of the interval of conver- 
00 

gence of the series and that the series of constants 

n«0 

fflo + ai + a* 4- • • • + o« + ■ • * 

is convergent. 

The function f„(x) = a:” satisfies the conditions of Abel’s test 
(Sec. 72) in the interval (0,1); hence, the series ^ a„x* converges 

n-0 

uniformly in the interval 0 ^ a? :S 1. 
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The proof of the case when the series converges at a; = — 1 
follows from the foregoing if a; in the given series is replaced by 

—a:. 

The theorem of Abel states that if the given power series is 
known to be convergent at one of the end points of the interval, 
then the interval of uniform convergence of this series can be 
extended to include that end point. Since a series of continuous 
functions that converges uniformly in a given interval defines 
a continuous function in that interval, it follows that the series 

eo 

^ Una;’', which converges at a: = B, defines a continuous function 

n -»0 

S{x) in the interval < z ^ R. Furthermore, since S(x) 
is continuous at a; = B, it follows that 



In the example (76-2) it was foimd that the series 

/J.2 /wS /fTl 

Six) X + I- + I-+ +^ + 

converges for x = — 1. Moreover, in the interval — 1 < a; < 1, 
Six) = - log (1 - *), 
and the theorem of Abel shows that 

lim Six) = lim [— log (1 — a:)] = — log 2. 

af ——1 X —► — 1 

But 

lim Six) = £?(-!) = -1 + H-H + 

X —► — 1 

Hence, 

— log2=—l + M — M + /4 — •••• 

77. Uniqueness Theorem on Power Series. 


Theorem. If the power series ^ o*®* and ^ both converge 

n =»0 «»*0 

in some interval about the point x = 0 and have the same sum 
for every value of x in this interval^ then the two series are identical. 
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(77-1) ao + aix + a2X^ + • • • + • • • 

= Jo + + h^X^ + ' * • + inX^ . 

for all values of x in some interval (—r, r), and since the function 
f(x) defined by these series is continuous for every point interior 
to (—r, r), it is certainly continuous at x = 0. 

Letting a; 0 in (77-1), there results 

do = Jo- 

Dropping ao and Jo in (77-1) and dividing through by x gives, 
for a: 7*^ 0, 

(77-2) ai + ci'2X + asX^ bi + J2a? + -j- . . . ^ 

Letting a; —> 0 in (77-2), there results 

ai = Ji 

and 

02 + asx + diX^ -j- • - • = J2 + bsic + biX^ + • • • , 
for X 7 ^ 0. 

A continuation of this process leads to the equality 

On = Jn 

for every value of n. 

This theorem asserts that one can equate the corresponding 
coeflBlcients of powers of x on both sides of the Eq. (77-1). Fre¬ 
quently, this theorem is called the uniqueness theorem on power 
series because it shows that there is not more than one way of 
representing a given function f{x) in an infinite series of powers 
of a? in a given interval. For, if two different methods lead to 
two power-series representations of a given function, then the 
two series are necessarily identical. 

78. Algebra of Power Series. It was shown above that a 

QQ 

power series converges absolutely for every value of :■ 

that lies within its interval of convergence. Consequently, 
it is permissible to rearrange the terms of the power series in 
any desired manner, so long as a; is interior to the interval of 
convergence. 
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The following theorems merely restate Property (D) of Sec. 61, 

and Theorem 2, Sec. 66, in a form applicable to power series. 

« 06 

Theorem 1. If ^ and ^ are two convergent power 

n«0 7is»0 

series defining^ respectively, the functions fi(x) and fzix), then 
the series obtained by adding them term by term is the power series 

eo 

^ (a« + b«)x“ = (ao + bo) + (oi + bi)x 

n-0 

+ (a2 + 62)^2 + • + (an + bn)x”' 4. • • • ^ 

which converges to fi(x) + f^ix) at least in the common interval of 
convergence of the two series. 

Example. 

- ^ ^ = 1 + a: + x* + - • ■ 

and 

cosx 1-| + |^- 

Hence, 

ll. ^ + cosa; = l + l+ a;-~ + x2 + ~+ • • • , 

and the result is, certainly, valid so long as — 1 < x < 1. 
Theorem 2. The series obtained by multiplying the two con* 

oe «e 

vergent series ^ and ^ bttX^, defining, respectively, the func 

»-«0 n—O 

tionsfiix) and/ 2 (x), and grouping the terms as for a finite product, 
is a power series 

ao5o 4“ (ao6i + aibo)x + (ao&2 + djbi + aJ)o)x^ + • • * 

+ (ao6n + ai6n—1 + • • • + anbo)x^ 4 . - . ^ 

which converges to fi{x) -fzix), at least in the common interval of 
convergence of the two original series. 

Example. 

1 4 X 4 4 ‘ " • , 


1 — x 
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and 

—^ = 1 + 2a: + + |j:» + 

1 — X 2 6 

and the result is valid if |x| < 1. 

The fonnidation of a theorem on division of power series 
is not so simple. Consider the reciprocal of the power series 

^ Ona:", namely, 

n«*0 


fix) = 


ao + aix + ojx® + 
If ao 5 ^ 0, one can write 

m 


o(l 


ao{ 1 + + 

da Aq 


ao [1 — (oix + oix® + 
1 1 


aol — y 

« 

where — 2? and y ^ a'x’*. 

do ^ 


n-1 


+ flw;* + 


+ ^x’^ + 

do 


+ + 


)] 


For all values of x for which the sum of the series ^ o'x" is 


numerically less than unity, so that \y\ < 1, 


n>l 


(78-1) Six) = ;^(1 -t- 1 / + y* + 

do 


. -j- yfc ) 

n — 1 

«0 

+ • • • + {x<x-Y+ 


n-1 


n-1 


Therefore, the problem is reduced to one that involves mul¬ 
tiplication of power series. However, matters are not so simple 
here, because each term of the series (78-1) is itself an infinite 
series, and it is imposrible to assert that the rearrangement 
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theorem (Sec. 66) established for the case of a single absolutely 
convergent series is still applicable. If the rearrangement is 

performed formaBy, there results a series in powers of Xj say 
«0 

and the question arises as to what connection, if any, 

n»*0 

exists between f(x) and the series so obtained. The reader wiB 
guess that the series (78~1) wiB converge for suflGlciently amaB 

eo 

values of y, so that the expansion wiB converge to f(x) 

0 

for small enough values of x. This surmise finds a justification 
in the foBowing general theorem, the proof of which is omitted:* 

Theorem 3. Given the power series f{y) = ^ hny^ where 

n^O 


y = 

h-O 

then the power series 

to to to 

n«0 na>0 jfcaBO 

will certainly converge for every value of x for which the sum of 
00 

the series ^ \a]^\ is less than the radius of convergence of the series 

ib-O 


n—0 

An important observation may be made in connection with 

this theorem. If the series for f(y) in powers of x is to converge, 

00 

then the radius of convergence R of the series must be 

n-O 

such that R > |aol. If uo = 0, then/(y) surely can be expanded 
in a power series in x whenever R > 0, 

This observation may be clarified by considering an example 
in which the process of substitution of one infinite series into 
^ See E[nopp, K., Theory and Application of Infinite Series, p. 180. 
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another is legitimate, and another example in which it is not 
legitimate. 

Let it be required to obtain a series in powers of x for the func¬ 
tion * by substituting 

X* , X* 

j, = smx^x-^ + 5j- • ■ • 
into the power series for e*', namely, 

e* l+y + |-i + |5+ • • 


The intervals of convergence of both of these series are infinite, 
so that 


e» = = 1 + 


+ 

+ 


( X* , x* \ 

V® 3!'^51 ■ ■ / 

l( x’ X® Y 

2!V 3! ■*'5! ‘ / 


= 14.3.4-—- — - ^ - 


4! 


8x® 

5! 


This result is valid. 

As another illustration, let it be required to obtain a power 
series in x for the function log (1 + e*). 

Setting 

(78-2) y + 

and noting that 

(78-3) log (1 -H y) ^ y - I* -I-1’ - I' + • • • , 

gives upon formal substitution of (78-2) in the right-hand member 
of (78-3), the series 

(7W) (i+»+i,+ •)-^(i+»+i;+ )■ 
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Denote the sum of the series (78-2) for any pajrticular value of 
a; > 0 by r; then (78-4) can be written as 

r — — 3 ^ 7 ^ + . . . ^ 

which diverges since r is always greater than unity when x > 0 . 
Accordingly, this method will not yield the expansion for 

f{x) = log (1 + e*) 

in a power series in x. 


It follows from Theorem 3 that if the series y = con- 

n"»0 

verges for all values of x and the series converges for 

n.««0 

all values of y, then the substitution of in terms of x and the 

ao 

rearrangement leading to the series X legitimate. 

n»“0 


PROBLEM 

Discuss the expansion of /(x) ^ in powers of x by nwng 

1 “h e* 




1 “ y +1/* - y® + 


and 


= l + x + ^ + 3l + 

79. Calculations Involving Power Series. It was established 
in the preceding section that if the radius of convergence R 


of the series is greater than zero, then one can divide by 

n-O 

the power series, provided that ao 5 ^ 0 . Moreover, the resulting 
expansion will be valid for sufficiently small values of x. Thus 

(79-1) -,-, o , ^ , Co + cix 

ao "h o^ix + ajx* -j- • • 

+ + • • • + + * * • . 
A practical scheme for determining the coefficients is outlined 
next. It follows from (79-1) that 
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1 = (ao + aix + -f. • • )(co + ax 

+ C2X^ + • • + CnX^ + ), 

and an application of the uniqueness theorem on power series 
gives 

CLoCo " Ij 

O'QCi + CtiCo = 0 , 

ci'oCi 4“ UlCi 4" <^2^0 = 0, 

aoCz + ^^1^2 + ^2^1 + ^3^0 == Oj, 


The first of these equations determines co, inasmuch as ao 5 *^ 0 
by hypothesis. A substitution of this value of co in terms 
of ao in the second of these equations yields ci. Consequently, 
the coefficients d may be determined successively. 

As an example, consider the problem of calculating the recip¬ 


rocal of the series 



which has more than illustrative 


n*l 

significance. Denote the quotient 


1+F! + |! + 


1 

(» + I)!"'' 


by ^Cna:", where Cn = Then 

fi-0 

(‘+ 5 +ii+ ■ ■ ■ + 151 ^ 1 + ' ■ ■ 


+Tr + 


) 


smd the equations for the determination of the B» are 
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1 D I 1 J_1_ I ... I 1 « 

nr““^ (n - 1 )! 1 ! (n - 2 )! 2 ! "^rKn-l)! ’ 


It is readily deduced from these equations that 

Bi = -H, B, = B. = 0, B, = -Ho, 

Bi = 0, B» = H 2 , B-j = 0, jBg = —Ho, ' ' ' 


These numbers (or their absolute values) are called BemouUPa 
numbers, and they play a prominent part in the theory of infinite 
series.* 

It may be remarked that 


! + £ + £: 4 . 
^ 2! ^ 3! ^ 


(n + 1 )! 

X 


+ 




Hence, 




n—O 


A similar procedure may be employed in calculating the 
quotient 


ao + aix + + 

bo + bix + b^^ + 


+ On X^ + 

+ + 

+ 


Co + CiX + CaX* 

• * + CnX^ + • 


where 60 7 *^ 0 . Clearing of fractions and equating the coefiS- 
cients of like powers of x gives 


a© = boCoy 

at = boCi + biCoy 

a% = boCa + biCi + b 2 Co, 


a» == boCn + biCn-l + * * • + bnCo, 
. .... 9 


* See Knopp, K., Theory and Application of Infinite Series, p. 183. 
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from which the coefficients c,- (with i = 0, 1, 2, • • • ) may be 
calculated successively. These coefficients are identical with 
those that would appear if one performed the division of the 
series by the ordinary rules for division of pol 3 niomials arranged 
in ascending powers of x. 


The calculation of the powers of an infinite series 
may be performed as follows. Let 


n-O 


(ao + CLix + • • • + ‘ ‘ + cix 

+ • • • + ca” + 


Then, 

m log (ao + cbix + ■ ‘ ' + Onaj" +•••) = 

log (co + Cix + • • • + c„a:“ +•••)• 

Calculating the derivative and clearing of fractions, one finds, 

m(ai + 2osX + • • • + na„x”“^ + • • • )(co + cix 

+ • • • + c„a:" +•**) = («o + OiX +• * • + a„a:" 

+ • * ' )(ci + + • • * + +•••)• 

Equating the coefficients of like powers of x on both sides of 
this equation gives a system of equations for the determination 
of ci, C 2 , • • • , Cn, * • • in terms of Co. Clearly co = oj*, so 
that the coefficients a (where t = 1, 2, • • • ) can be determined 
successively. 

PROBLEMS 

1. Show by squaring the series that 

(1 + x + *» + +x’ + - ■ ■ y 

= 1 4- 2x + 3x* + + (» + 1)X» + • • • 

1 


i T » T 2,-r 3j-r 
and 

aj* a?* 

gux X X -1— — 

31^51 


find the power series for e* sin x, 
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3. Show formally that if/i(a:) = ^ cure" and/»(x) = where 


n»0 


n^h 




hk 7^ 0, then the quotient will be of the form 

/2W 


C-i I C— 4+1 j I C-i , , t « , 

+ —jrr + • • • H- — + Co + Cl* + cjx* + • • • 

4, Reversion of Series. K 

(1) y — yo = ai(x — So) + Oiix — * 0 )* + • • • 

conver^ for I* — *ol < R, and if Oi 0, the series may be solved for 
a; — *0 in terms of y — yo to give 

(2) X — *0 = bi(y — yo) + bi(y - yo)* + • • • . 

If ^ ^ is replaced by *, and x — Xo is set equal to x', the series (1) 
assumes the form 

(!') s = ajx' + oi®'* + + a'x'* + • 


where a* = —> (n = 1,2, ), and (2) becomes 

Cl 

(20 x' -=‘h[z + h'^^ + — * + + • • 

where 

= ftucj. 

Substituting (20 in the right-hand member of (10 and equating the 
coefficients of like powers of z, one obtains a set of equations for the 
determination of the coefficiente 6'. 

Carry out the reversion of the series 


y = 8mx 

to obtain 


ly* 

X = sm-‘y = y + -j + 


1 -Sy' 
2-45 


+ 


1- 3-5y» 

2- 4-6 7 


6. Use the procedure of Sec. 79 to calculate the first three terms of the 
series for to verify the expansion 


^ = I - ^*(2* - 1)| - W - l)g-5.(2- - 1 ^ 
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6. Pmd the first three terms of the series for sec x obtained by 
calculatmg 

1 __ 1 _ 

cos a; 1 _ I _ 

^ 2 ! 4 ! 


7. Obtain the expansion for 


X 

sin X 


x^ . 

® 3l'^5I 


— g"”* 

8. Find the series for sinh x s--— and cosh x m --— 


with the aidof6*=l + « + ^+ ^ + ‘ • * . 

9. Find the expansion for tanh x s —^-with the aid of 

e* + e“* 

a?* x^ 

• • . 

10. Assuming 

/(®) = 2 )®^’ 
n-'O 

show by successive differentiations of /(a?) that the coeflicients an are 
of the form 


/(-)( 0 ) 


so that 




This is the Maclauxin series. 





CHAPTER IX 

APPLICATIONS OF POWER SERIES 

80. Extended Law of the Mean. It was shown in Sec. 20 that 
a function f(x) that is continuous in the closed interval (a, x) 
and posse^es a derivative at every interior point of the interval 
can be written in the form 

where { is some interior imint of the interval (a, x). This 
r^ult, known as the law of the mean, can be extended if the fimc- 
tion f(x) together with its first n — 1 derivatives is continuous 
in the closed interval (a, h), and if its nth derivative exists at 
every interior point of (o, b). 

In order to obtain the extended law of the mean the 

function F(x) by the equation 


F(x) ^ m - fix) - (6 - x)fix) - ^ ^f^'r ix) 

--/w 


- (J - ajf (g) 


- ~ °)V va) _ . . . _ (& - 

^ ^ ^ (n- I)!-' 


2 ! 




which is so constructed that 

F(a) = Fg>) = 0 . 

The derivative of jP(x) is readily found to be 
(80-1) r(x) - 

- • • 

_ (6 - 


-»(«)]. 
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Since the function F (a;) satisfies the conditions of Rollers theorem, 
F'{x) must vanish for some value of x, say a; = interior to the 
interval (a, 6). 

Setting ic = £ in (80-1) gives 


(80-2) m = /(a) -h (6 ~ a)/'(a) + • ■ 


a)” 


nl 




wtere a < ^<h. Now, if 6 in (80-2) is set equal to x, one 
obtains the formula which expresses the function f(x) as a 
polynomial of degree n in a: — a, namely, 


(80-3) m 


■ f(a) + (x ~ a)r(a) + 
(x 


+ 


(n - 1)! 




where a < ^ < x. The coejEcients of the powers of a; — a in 
(80-3), except the last one, are constants. The coefficient of 
(x — a)" is a function of which in turn depends upon the 
magnitude of a:. It may happen that this last term in the 
formula (80-3) is negligibly small in comparison with the preced¬ 
ing ones, and in such a case the function f(x) can be approxi¬ 
mately represented by a polynomial of degree n — 1 in x — a 
with constant coefficients. 

The formula (80-3) is known as Taylor^s formula, and its 
last term, 

(80-4) E. = 


is called the Lagrangian form of the remainder after n terms. 

The foregoing derivation of the Taylor formula is not devoid 
of some artificiality, and the reader may have a feeling that the 
definition of the function F{x) anticipates the result. The 
foUowing section is devoted to a discussion of two simpler 
methods of deriving formula (80-3), but the gain in simplicity 
there is achieved by imposing restrictions on the function /(x), 
which are more severe than those required by the proof given 
above. It should be noted that the proof just given requires 
neither the continuity of the nth derivative in (a, 5) nor its 
existence at the end points of the interval. 
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81. Taylor’s Formula. If the function/(a:) is assumed to have 
a continuous nth derivative throughout the closed interval 
(a, 6), it is possible to give a simple derivation of Taylor’s formula 
by integrating the nth derivative of the function n times in 
succession. Thus, if x is any point of the interval (a, 6), then 


f /(“’(a:) dx - = /C"-«(x) — 

J a |a 

n /(»^(x) (dx)2 = fV-">(x)dx- 

Ja 

= /("-»(x) -/c»-»(a) - (x - o)/(’*-«(a), 
(dx)» =/(»-« (a;) -f»-®(a) - (x - o)/(’‘-»(o) 

i 




2 ! 




r- 


^/(»>(x) (dx)» = /(x) - /(o) - (x - a)/'(a) 

- - 

Solving for f(x) gives 

(81-1) /(x) = /(o) + (X - o)f (a) -h ■ ^--~,°^V ’(a) 
where 


(81-2) ~X* ’ ’ ' 

It is easy to transform the integral form (81-2) of the remainder 
to the Lagrangian form (80-4) with the aid of the first mean-value 
theorem for integrals.* In fact, 

J^*/<’‘^(x) dx = (x — o)/^“K^)) where a ^ J ^ x. 

Integrating both members of this equation n — 1 times, between 
the limits a and x, gives 


* See Sec. 37. 
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12 , = (dxy 

which is the Lagrangian form (80-4) of the remainder. 

Another proof of Taylor's formula, which leads to an extremely 
useful form of the remainder iJn, depends on the integration by 
parts of the obvious identity 

(81-3) /(a 4- A) - m = £r{a + h-t) dt, 

where the prime over / denotes the derivative of the function 
with respect to its argument a + h — t. 

Integrating (81-3) by parts successively gives 


f(a + h) - f(a) = jj{a h - t) dt 

— h — t) -f- ^ 4“ A — dt 


= hf{a)+^tTia + h-t) 


+ h-t)dt 


= ¥'(o) 4- |j/"(«) 4- • • • 4- 

Setting h — X — a, one obtains 

Six) = /(a) 4- (* - a)/'(o) + +. . . . 

where 

(81-4) - t) dl. 

If the variable of integration in (81-4) be changed to X, which 
is defined by the relation \ = x — t, then (81-4) becomes 
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(81-5) = ■( —. i)t JV>(X)(x - X)-idX. 


In order to obtain the Lagrangian form of the remainder from 
(81-5), it is only necessary to apply the first mean-value theorem 
for integrals.* Since o ^ X a:, (x - X)"-^ does not change 
sign in the interval of integration, and formula (37-3) gives 


fin 


(n- 1)! 



- X)»-i dX = 


(x - a) 
n! 


■/«(!), 


where a < ^ ^ x. This establishes the identity of (81-5) with 
the Lagrangian form (80-4). 

A special form of Taylor’s formula, which results from setting 
o = 0 in (80-3), is known as the Maclaurin formvla. It is 


(81-6) fix) = m + 3f'i0) + |J/"(0) -!-■•• 

+ (;Sy/'"-"(o) + fi»’ 

where 


fin 




0 < f < X, 


or 

i)j X/^"^(^)(^ - 

The Lagrangian form of the remainder is frequently written 
in a slightly different form. Setting x — a = A and recalling 
that a < f < X, one can write 


J == d “h Shj 


where $ is some number lying between 0 and 1, The number 
6, of course, depends upon the value of x. Consequently, 
the formula (80-3) can be written as follows: 

fia + h)= fia) + f'ia)h + 

, /'’‘’(o + 9h). 
n! 


where 0 < 9 < 1. 
♦ See Sec. 37. 
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82. Taylor’s Series. It was shown in Sec. 80 that Taylor’s 
formula, 


(82-1) /(a;) = /(a) +f(fl){x - a) -f 


+ 


(g) 

(n - 1)! 




{x - +''-^(x - ay, 


permits one to express a suitably restricted function f(x) as a 
polynomial of degree n in x — a. The first n coeflicients of 
the powers of x — o in (82-1) are constants, whereas the coeffi¬ 
cient of (x ~ o)* is a function of x, inasmuch as the magnitude 
of f depends upon the choice of x. 

It may happen that /(x) is of such a nature that the remainder 

n = — a)“ is bounded for aU values of x in the interval 

(a, h), so that 


\Rn(x)\ = 


n! 


(x — a)’ 


^ Mn, 


where ilf„ is a boimd which in general depends on both x and n. 
If the function /(x) has derivatives of all orders in the interval 
(o, b), and if jB* tends to zero uniformly as to $ in (o, x) as n —» «, 
then the formula (82-1) can be written as the infinite series 


(82-2) fix) = fia) +f'(a)(x ~ a) + 


/"(g) 


(x 


2 ! 

n\ 


-a)^ + ■ ■ 
(x — o)^ + 


which is known as Taylor’s series. A special case of Taylor’s 
series (82-2), obtained by setting a = 0, is known as Maclaurin’s 
series. It is 

(82-3) fix) =/(0) -f/'(0)x + 

/^“>(0). 


The demand that f2„(x) tend to zero uniformly with the 
increase of n is sufficient to deduce the infinite series representa- 
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tion (82-2) of the function f(x). Stated in precise form this 
requirement means that for each x in (a, b) and any e > 0, one 
can find a positive integer N, independent of the choice of | in 
(a, x), such that |ii«(x)l < « for all» ^ 7^. 

It may happen that a formal application of the formula (82-2) 
will yield a series which does not represent the function with 
the aid of which the series is generated. An example, due to 
Cauchy, may help to clarify this assertion. Let it be required to 
expand the function 


f{x) = e if X 0, 

= 0, if X = 0, 

in Maclaurin’s series. Calculating the derivatives of /(x) gives 


m = 


2 -4 


/"(x) = 


4 - 6x* -4 
—rs —e »•, 


/(»>(x) 


TO 4 

XP 


where P(x) is a pol 3 naomial in x, and p > 1. 

If the value of (x) at x = 0 is calculated,* it is found that 


f(0) =r(0) = • • • =/«(0) = 

Therefore, the formula (82-3) gives 


= 0 . 


0 + 0 • X + ^x* -h 


0 


• • -f- -f- • 


which converges to zero for all values of x, and hence fails to 

_1 

represent the function e Moreover, if ^(x) is any fimction 
that can be represented by Maclaurin’s series as 


<pix) = ^9(0) 4- /(0)x -f- 


^Cn)r 


* See Sec. 14. 
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F(x) = <p(x) + e ** 

will have a Maclaurin expansion that is identical with that for 

_1 

<p{x). The reason why the function f(x) = 6 ** cannot be 
represented by a Maclaurin^s series is that the remainder, 

(0<S<«). 

does not converge to zero for each x in any interval including 
the point a? = 0. Of course, Taylor^s formula (82-1) can be 

applied to give a representation of e and in this case the 
expansion about the origin reduces to a single term, which is 
precisely the remainder Rn- 

It follows from the uniqueness theorem on power series* 
that if any function can be represented by a power series, then 
the coefficients in the power series must be identical with those 
appearing in the Taylor's series representation of that function. 

83. Applications of Taylor’s Formula. 

(a) The Expansion of Sin x. Let it be required to expand the 
function f{x) = sin x in Maclaurin's series. Now, 


/(x) = sin X, 
/'(x) == cos X, 
J”{x) = —sinx, 
/'"(x) = —cosx, 


/(O) = 0; 
/'(O) = 1; 
/"(O) - 0; 

r'(0) = -1; 


y*(«)(x) = sin 


( I 


/(»)(0) = sin 


nv 


A substitution in the Maclaurin formula (81-6) gives 

X* , X* x* , I *" • A I 

= 

and, since 

0 < f < X, 

it follows that 

ex, 

* See Sec. 77, 
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where is some positive number less than unity. Thus the 
remainder is 

(83-1) ^ sin (^0x + 

But the numerical value of sin x never exceeds unity, so that 


R, 


for all values of x. Now if x is confined to lie in the interval 
'dj where r is an arbitrarily large positive number, then 


lim 




0 


for all values of x such that la:| ^ r. Consequently, Bn(x) 
converges to zero uniformly in any finite interval (—r, r), and 
one is justified in writing 






r*»—1 


(2n - 1)! 


In order to illustrate the use of the remainder in estimating 
the magnitude of the error made in calculating the value of 
sin X with the aid of the infinite series, let it be required to 

compute the numerical value of an 10°. Since 10° = ^ radian, 

formula (83-1) gives 



In particular, if » = 9, the polynomial 


y 3! 5! 7!/,.x 18 



gives the value of sin jg with an error that is less than 
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(b) The Expansion of e*. A procedure entirely analogous to 
that employed in the preceding example gives for e* an expansion 

i + j + + o<.<i. 

A little reflection shows that for all values of x such that \x\ $ r, 
where r is any positive number, 


lim ^ e'* = 0. 

n->« 


Consequently, one can write 
(83-2) e*=l + ^ + ^j + 

For x = 1 this formula gives 


+ S + 


+ ^ + 


H the sum of the first n terms is taken as an approximate value 
of e, the error is less than 

+ ■ ■ ■ ) 


since each term of this series is not less than the corresponding 
term of the series 

i . + — i . +..-1 +. 

n!^ (ra + 1)! (n + 2)! ^ 

Thus for n.= 10, the error is less than 

Wr^o 00000003 , 

and the value of e is easily foimd to be 2.718282 correct to six 
decimal places. 

If it is desired to obtain values of e® when 1 < a: < 2, then 
the power series in a; — 1 is more useful than (83-2). The 
expansion off(x) in powers of a: — 1 is 
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m = m +/'(!) -1) -1)2 + ... 

and, since 

fM{x) = e* /W(l) = e, (n = 0, 1, 2, - • • ), 

(83-3) e» = e[l -f- (a: - 1) + ^(x - i)* + • • - 

The remainder in this case is 

so that the error made in using only four terms of the expansion 
(83-3) is 

B* = ^(a; - 1)*, (1 < I < x). 


If a; = 1.1, then 


gX.J 


= e 


: + o.i + (^ + l»3 


3! J ^4! 


( 0 . 1 )^ 


1 1AKO 1 0.0001 , 

= 1.10526 -\ -—6'- 

24 


Since 1 < { < 1.1, and since is an increasing function, 
is certainly less than so that Ri is certainly less than 


0.0001 , 


< 0.00003. 


(e) The Binomial Theorem, The fact that the binomial series 


(8M) 1 + «, + + . . . 

J m(m - 1) ■ • • (m - w + 1)_. , 

-f- _ a; -h • • • 

converges for all values of x such that |a:| < 1 is readily established 
with the aid of the ratio test, but it is not so easy to prove that 
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the series (83-4) actually converges to the value of (1 -f x)» 
when m is not a positive integer. 

This section concludes with the discussion of the convergence 
of the expansion for the function 

f{x) = (1 -I- a:)”. 

The derivatives of f{x) are found to be 

fix) = jw(l -h x)”^''-, 
f'ix) = m(m - 1)(H- a:)”*-*, 


/(»)(a;) = TO(m — 1) • • • (m — n -f- 1)(1 -|- a:)”*-". 

Substituting the values of these derivatives, calculated at a: = 0 
in Maclaurin’s formula (81-6) provides the expansion 


(1 -h a:)“ = 1 •+• ma: -f — —^a:* -f 

m(m 


. mim — 1) ••• (m — n + 2) 

+-r - ■ i\. - 


in - 1) 


+ 22. 


where Bn can be expressed either in the Lagrangian form (80-4) 
or in the form of the integral (81-6). 

It is more convenient to discuss the behavior of by express¬ 
ing it in the form (81-5), so that 


(83-5) B.- 

It follows from the first mean-value theorem for integrals 
(Sec. 37) that 

(83-6) jjil -f X)'»-»(a: - X)”-^ dx = (l-f- f)’»-»(a: - f)"~^J^dX 

= (1 + i)”-’‘(a: - f)"-!®, 

where 0 ^ f ^ a;. 

The substitution of { = te, where 0 ^ ^ 1, permits one to 

express (83-6) in a more convenient form, namely, 

jr*(l + \)”-^ix - X)’‘-‘ dX = (1 -f ex)’^-^il - fl)»-ia:» 
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(83-7) R. 


■(m-l) • • • (m-TO+1) 

■ 1-ffT 








If X is confined to the range — 1 < a: < 1, then the first bracket 
in (83-7) tends to zero as n becomes infinite.* The second 
bracket, obviously, does not exceed unity if [xj < 1, and the 
last bracket is independent of n. Accordingly, 


lim Rn = 0 

n—* « 


for all values of a; in the closed interval (—r, r), where r is any 
positive number less than unity. Consequently, it is permissible 
to write 

(1 + «)» l + mx + - ^27 

^ m(TO - 1) (m - TO -f l) j. _|_ 

n! 

The ratio test shows that this series diverges if the numerical 
value of X is greater than 1, so that the series does not represent 
the function (1 + x)^ for \x\ > 1 unless m is a positive integer. 
If r = ±1, the ratio test fails, and one must resort to more 
delicate tests to establish the behavior of the series in this doubt¬ 
ful case. 

It follows directly from Kummer^s test (Sec. 63), upon setting 
a« — n, thatf the series 

n— 1 

(o) converges absolutely if Hm n\ 


j^-i) 
Wm-1 / 


> 1 , 


♦For, consider the sequence {on} whose general term a» is equal to 
——Then lim =* lim |a;|, and 

it follows from the ratio test that the sequence (a»} is a null sequence if 

w < 1. 

f This is known as RaahFs Seealso Prob. 6, Sec. 63, 
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and 


( 6 ) 


«0 

diverges if lim n( — 1^ < 1. 
»-► 00 \JWn+l / 

»«il 


The general term Un of the binomial series is 

Wi 

so that 


m(m — 1) • • * (m — n + 1) ^ 
__ 


Un 

Wn+1 

Consider first the case when a; = — 1. Then 


Wn _ n + 1 
Un+i n — m 

so that 

lim - - - l') = 1 + m. 

It follows from (a) and (6) that, the series 


and 


converges if m > 0, 
diverges if m < 0. 


If ® = 1, the series (83-4) becomes alternating if n > m -|- 1, 
so that the absolute value of the ratio of the nth term to the 

(n -I- l)st is still ——• The foregoing discussion shows that 

in this case the series converges absolutely so long as m > 0. 
If m < 0, the series of absolute values diverges, but the alter¬ 
nating series may converge conditionally. From the structure 
of the general term 

_ mim - 1) • • • (w - n + 1) 

■— -j- - 

n\ 

it is clear that if m ^ -1, the successive terms do not decrease, 
so that the series diverges in this case. 

If m is between 0 and — 1, one may write the absolute value 
of 14,1 in the following form: 

w.(1-4-2)...(l-?). 
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where a — 1 + tn. It will be shown next that lim ltt„| = 0, 

»—> « 

SO that the series is convergent (since it is obvious that 

l«»+l! < l«n|). 

Now 

n 

(83S) log 1«„| = 2log (l - 

Jfc«l 

and, since 1 — ^ is less than unity, each term of the series 

(83S) is negative. It is easy to show, with the aid of the integral 
test of Cauchy, that (83-8) diverges if n —> oo . Therefore, 

lim log \un\ = — 00 . 

«0 

But if log becomes negatively infinite as n oo , then [waj 
itself must tend to zero. 

The results just obtained can be summarized as follows: 
The series (83-4) is convergent if |a;| < 1 and divergent if \x\ > 1. 
If a; = 1, convergence is absolute, if m > 0. 

If a; = 1, convergence is conditional, if — 1 < m < 0. 

If a: = 1, the series is divergent, when m ^ —1. 

If a? = —1, convergence is absolute if m > 0. 

If a; = —1, the series is divergent when m < 0. 

It follows immediately from AbeFs theorem on the continuity 
of power series (Sec. 76) that if the binomial series converges 
for a; = 1, then its sum is precisely equal to 2**. If a; = — 1 and 
m > 0, then the sum of the series (83-4) is necessarily zero. 

PROBDSMS 

1. Verify the following expansions: 

(a)-(e. + e-) ! + - + _ + - + 

.) * + + + + 

(d) log » - — 1) — HQe — D* + H(.x — 1)* — 
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(e)logx = ^Vi(^) +|(^) + 


[Hint: Set x - in 1W]; 
z 


if) tajia; = a: + |-+^a:‘+^a:^ + 


17 


ig) see «■ 


15 

5x* 


315 

61a:« 


62 

2835' 


a:» + 


^ 2! 41 6! 


. la;» . l-3x» , l-3-5 g^ , 
ih) sm he ‘® + 23'^‘2-45'^2-4-67'^ 

x"* 

(tO tan-^ " * ’ 


la:» , l-3a:' l-3-5a' 

if) log ix + Vl + »“) =*“23"*" ^ Y “ 5!"“ + 


2-45 2-4-67 




, , , a:* 3a;* Sa;® 3a:* , 
^ + * + 2! 4! 5! 6! 

‘+*'+ri+i*'+a*‘+" 


2. Expand: 

IT 

(а) tan x in powers of a; — 

(б) e* in powers of a? — 2; 

IT 

(c) sin X in powers of x — 

D 

(cZ) 2 + X* — 3x® + 7x® in powers of x — 1; 
(e) log X in powers of x — 2. 


84. Euler’s Formulas and Hyperbolic Functions. Two par¬ 
ticular linear combinations of exponential functions are of such 
frequent occurrence in mathematics that it has been found 
convenient to give them a special name. The expression 
3^(e* + is called the hyperbolic cosine of x, and is denoted by 

cosh X s + e“^). 

The derivative of cosh x is equal to 3^(e* — e“*) and is called the 
hyperbolic due of x. Thus, 

sinh X = 

These functions are named h 3 rperbolic because they bear 
relations to the rectangular hyperbola x* — = a* that are 

very similar to those borne by the circular functions to the circle 
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+ y* = a®. The formal analogy between the circulax and the 
hyperbolic functions is best exhibited by the table given later 
in this section. It will be recalled that the expansion in Mac- 
laurin’s series for e“ is 

(84-1) e- = H-«+|J + Jj+ • 

so that 

(84-2) 1 + a: + £. + g + 

and 


(8M) + 

Subtracting (84-3) from (84-2) gives 

60 that 


(84^) sinh ^ + ^ + ^ + 

On the other hand, addition of (84-2) and (84-3) gives 

(84-5) coshxs®' + ®' =l-l.|; + ±^ + 

Moreover, if it is assumed that (84-1) holds for complex numbers 
as well as for real numbers, then 

(8M) l+i.+^‘+(^ + 

and 

(84-7) e-“ - 1 - i,-t-1::^-4 4- 

where is ''-—1. Adding (84-6) and (84-7) and siniplif 3 dng 
shows that 


QtX 0-ix 




which is recognized to be the series for cos x multiplied by 2. 
Thus, 
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gix ^ g-t* 

(84-8) cos a: =-g- 

It is readily verified that subtraction of (84-7) from (84-6) leads 
to the formula 


(84-9) 


sinx = 


— e~ 


2i 


By combining (84-8) vdth (84-9) there result two interesting 
relations, 

cos X i sin x = e‘* aiid cos x — i sin a: = e 

which are known as the Eider formulas. 

The following table exhibits the formal analogy that easts 
between the circular and hyperbolic functions; the relations 
that are given for hyperbolic functions can be established readily 
from the definitions for the hyperbolic sine and the hyperbolic 


cosme: 

Circular Functions 

sin X = “ «“**) 

2% 

cos X = H 


tanx 


cotx 


e'* — 

-f e’ *) 

1 

tan X 


cos X 


i= —smx 


' sec* X 


Hyperbolic Functions 


sinh X ~ 


• e-*) 


cosh X “ K ^ 
e® - c"* 

tanhx 


cothx 


e* + e“* 
1 

tanh X 


x» 


x« 


cosr=l 

sin* X + cos* X = 1 
1 + tan* X = sec* x 
sin 2 x = 2 sin X cos x 
eos 2x = cos* X — sin* x 
sin (x ± 3 /) — sin X cos 3 / ± 

cos X sin y 

dl sin X 
dx 

d cosx 
dx 

tanx 
dx 


rinh® '®+^+^ + 


cosh X ' 1 + ;;^ + 7 : + 

2! 4! 

cosh* X — sinh* x = 1 
1 — tanh* X = sech* X 
flinb 2 x = 2 sinh x cosh x 
cosh 2 x - cosh* x + sinh* x 
sinh (x + 3 /) = sinh x cosh 3 ^ 

± cosh X sinh 3 / 

^2 sinh X , 

- = coshx 

dx 

d cosh X 
dx 

d tanhx 


dx 


s= sinhx 
s sech® X 
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85. Integration of Power Series. It was shown in Sec. 75 that 
a power series converges uniformly for all values of a? in any 
closed interval that is interior to the interval of convergence. 
Moreover, the series resulting from term-by-term differentiation 
and integration of a power series have the same intervals of con¬ 
vergence as the original series and will converge to the derivative 
and integral of the function represented by the given series so 
long as X is interior to the interval of convergence. These 
facts are of great use in obtaining the power-series expansions 
of functions defined by integrals. 

Thus, consider the integral 


dz 

jol + z^ 


tan~^ X. 


Expanding the integrand in a power series in Zj one obtains 


tan“^ X 


= r*(l — + 

(Jo 



) dz 


Inasmuch as the i)ower series in the integrand is convergent for 
l^l < 1, one is assured that the expansion for tan^^ x is con¬ 
vergent for |xl < 1. The reader will convince himself that the 
procedure employed here in deriving the power series for tan“^ x 
is much simpler than that of calculating the successive derivatives 
of tan"”^ X and applying the Maclaurin formula. The uniqueness 
theorem guarantees that the expansion obtained above for 
tan~^ X is precisely the Maclaurin expansion. 

Obviously, the series converges at the end points x ±1 
of the interval. Since the series converges for x = 1, it follows 
from Abel's theorem (Sec. 76) that the series actually converges 

TT 

to the value tan“^ 1 = t* Thus, one arrives at the conclurion 

4 

that 



Consider another example, namely, 


lo g (1 + x) 
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logd+a;) 


=/: 


(1 — 2 + 2® 


) dz 


JU , ^ 

* “ ^ + ‘3 


This expansion is valid for |a:| < 1. For a: = —1, the series 
is divergent. For a; = 1, it converges, and it follows from Abel’s 
theorem that its sum is log 2. 

PROBLEMS 

1. Show that the remainder in the expansion of log (1 + a;) is 


Bnix) = 


z”- dz 


( — I)” 


0 1 + ^ (n+ 1)(1 + dx) 


2. Obtain the expansion 
dz 

vr^ 


sm 




, la;®, 1 • 3a;®, 
* + 23 + 


and show that 


1 = 1+1.i+u.i + 

2 2 32*4 5 

3. Show that the remainder in the expansion of tan~^ a; in a power 
series in x is 


RM 




+ 2- 


dz = 


_2^^n^2n+l 

(2n + 1)(1 + (Ox^y 


and show that jBn(l) 0 when n -+ oe. 


86 . Evaluation of Definite Integrals. One of the important 
uses of infinite series is in the evaluation of some difficult integrals 
for which the indefinite integral cannot be found in closed form. 
Three interesting examples of this use of infinite series are given 
below. 


The integral 




dx cannot be evaluated with the 


aid of the fundamental theorem since the indefinite integral 

^ __ 0—x 

cannot be obtained in closed form. The expansion for 


X 


if obtained directly, would lead to an extremely complicated 
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expression for each derivative. The expansion is most easily 
obtained by using the separate expansions for and e“®. Thus, 

e*=i+x+|-;+i;+ 

<>•2 /ftZ 


and 

Hence 

— e 


€* — 6“ 


+1] + li + ■ ■ ■ )■ 


Jo"* = + 

In order to evaluate the integral J^ef^*dx, recall that 


2.1145. 


so that 


e*‘=l+u + | + g + 


, 1 , • , sin*a; , sin*® , 

e*>* = 1 + sm ® H—575-1--h 


2! 


Then 


i: 


e^^dx 


■j:( 

-rt 


1 + sin a; + 


2! 


. sm*' X . 


) 


dx 


, , . , sin* X , sin* x , 

1 + sm® + —£ 5 ^ H-^ + 


2 ! ' 3! 

which can be evaluated with the aid of the Wallis formula, 


^ dar, 



sin"®d® 



cos” xdx = 


(n-l)(n-3) • • • 2orl 
n(n — 2) • • • 1 or 2 


IT • # 

where a = 1, if n is odd; and a = if n is even. 

Let it be required to evaluate the integral* 

* The integrand in this integral becomes discontmnous at a; * 1, but it ia 
easy to establish the convergence of the integral (see Sec. 95). 
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fl_&__ 

Jo V(1 - *^)(1 - 


where ft* < 1. 


A substitution of a: = sin 6 reduces the integral to 


K 


i 


_ dd 

"s/l — ft* sin* 9 


But 


(1 - ft* sin* 9)-^ = 1 + ift2 sin* 9 + |f|ft< sin^ 0 + • • . 
Consequently, 


T 



sin* 6 d6 


+ • • • 



since 


1-3 


(2n - 1) 


+ 


2-4 
3 




2n 

(2n 


2-4 


2n 


■/> 

^yft*» 


sin*" 9 d6 


+ 



sin*" 9 dd = 


1 -3 
2-4 


(271 - 1) t 
• • 2n 2 


If ft is near unity the convergence of the resulting series is not 
so rapid as may be desired. In such a case a substitution of 
Z* = 1 — ft* can be made, so that 

(1 — ft* sin* 9)-^ = -^^(1 + taut* ^)~^- 
coa 9^ ' 


Expanding the right-hand member of this expression by the 
binomial theorem and integrating term by term gives a series 
that converges rapidly for small values of 1. 


PROBLEMS 

1 . Calculate cos 10®, and estimate the maximum error committed by 
neglecting terms after xK 
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2. Find the interval of convergence of the expansion of e* in power 
series in x, determine the number of terms necessary to compute 
accurate to four decimal places from this expansion. 

3. Compute sin 33®, correct to four decimal plaoes. 

4. Develop the power series for tan*"^ z in powers of Zj and find the 
interval of convergence. 

r® da; 

6. Expand the integrand of I ——; in power series in x. and inte- 

Jo 1 + 

grate term by term. Compare the results with that of the preceding 
problem. 

6. Compute = 2(1 + % 2 )^i correct to five decimal places. 

7. Develop the power series in z for sin~^ z and hence establish that 

6 2^2 3\2j ^2-4 5\2/ ^ 

8. Differentiate term by term the power series in x for sin x and thus 
obtain the power series in x for cos x. What is the interval of conver¬ 
gence of the resulting series? 

9. Divide the series 


sm z 


3! ^5! 


by the series 


x^ X* 

and thus obtain the series for tan z. 

10. Differentiate the series for sin“^ x to obtain the expansion in powers 
of z for (1 — a;*)”^. Find the interval of convergence. Is convergence 
absolute? Investigate the behavior of the series at the end points of the 
interval of convergence. 

11. The integrals 


F(Jc, <p) 


and 


Eik, v) = - A* sin* dd, 

where < 1, are called the elliptic integrals of the first and second hinds, 
respectively. Discuss the evaluation of these integrals. The numbers 
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F\h, ^ and E\^f are called the complete elliptic integrals and are 

denoted by the letters K and respectively. The values of the func¬ 
tions <p) andJS'Cfe, <p) are tabulated.* 

12. The major and minor axes of an elliptical arch are 200 ft. and 
50 ft., respectively. Find the length of the arch. Compute the length 
of the arch between the points where a? = 0 and x = 25. Make an 
estimate of the remainder. 

13. Show that 


r 2 dx _ r 
Jo Vsin * Jo 


2 dx 


V2 


i 


dip 


0 1 — H shi* P 


Hird: Set \/cos x = cos <p. 

14. Show that 


i 


2 sin* 6 dB 




Hint: sin* ^ ^ ““ sin* 9). 

16. Show that 






dS 


0 \/l — Aj* sin* $ 




if ifc* < 1. 

16. Find the length of one arch of the sine curve. 

17. Find the length of the portion oi y = sin x lying between a; - 1 
and X = 2. 

18. Show that the length of arc of an ellipse of semiaxes a and 6 is 
given by 



where e is the eccentricity. 


See, for example, Peirce's A Short Table of IntegralB. 



§87 APPLICATIONS OF POWER SERIES 315 

Estimate the magnitude of the remainder after three terms, 

19, Evaluate in series: 


(a) r sin (a;2) dx; 
Jo 

,. r^sina; - 

(c) I - dx; 

Jo X 

(e) r cos (a?®) dx; 


cos X dx 

0 


(6) sin a; (te . 

Jo Vl — **’ 

(d) J' e~*’dx; 

CO (2 — cos x)~^ dx 

(h) I * dx. 

Jo 


20. Show, by squaring and adding the power series for sin x and 
cos X, that 

sin* X + cos* aj = 1. 



Fig. 73. 


87. Maxima and Minima of Functions of One Variable. A 

function/(x) is said to have a maximuin at x = a, if 


and 


A^^f(a + h) -/(a)<0, 
A- s /(c -A) - S{a) < 0, 


for all sufficiently small positive values of A. If A+ and A~ are 
both positive for all small poative values of A, then /(x) is said 
to have a minimum at x = a. 
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It is shown in the elementary calculus that if the function 
f(x) has a derivative &tx = a, then the necessary condition for a 
mfl-yiTTuiTn or a minimum is the vanishing of f{x) at the point 
X = a. Of course, the function f{x) may attain a maximum 
or a minimum x — a, without having fid) = 0, but this can 
occur only if f{x) ceases to exist at the critical point (see Fig. 
73). 

Let it be supposed that f{x) has a continuous derivative of 
order n in some interval about the point x — a. Then it follows 
from Taylor’s formula that 


L+^S(fl + -h) -f{a) 

= /(o)A+^/i^+ • • 


+ 


(n-l)r n! 


where 0 < tfi < 1, and 


A-^y(a-h) -f(a) 

= -/'(a)A - 


(n-l)r 




where 0 < ^2 < 1. Let it be assumed further that the first 
n — 1 derivatives of/(x) vanish at a; = a, but that(a) is not 
zero. Then 


and 


n! 


i- . W) >., 


Since is assumed to be continuous in some interval 

about the point x = a, + 9ih) and — B^h) will 

have the same sign for sufficiently small values of A.* Con¬ 
sequently, the signs of A+ and A~ will be opposite unless n is 
an even number. But if /(x) is to have a maximum or a minimum 
at X = a, then A+ and A~ must be of the same sign. Accordingly, 
the necessary condition for a maximum or a minimum of /(x) 


* See Theorem 3, Sec. 12. 
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at X = a is that the first nonvanishing derivative of f(x), at 
X — a, be of even order. Moreover, since both A+ and A" 
are negative if f{x) is a maximum, it follows that must be 

negative. A similar argument shows that, if f(x) has a minimum 
at X = a, then the first nonvanishing derivative of f(x) at x = o 
must be of even order and positive. 

If the first nonvanishing derivative of /(x) at x = a is of odd 
order, and /"(a) = 0 , then the point x = a is called a point of 
inflection. 

Example, Investigate fix) = a:® — 5 x^ for maxima and 
minima. Now 

fix) = 5x^ — 20 x^, 

which is zero when x = 0 and x = 4. Then 

f\x) = 20 x« ~ 60x2, y//(o) y//( 4 ) 320 ; 

/"'(x) = 60x2 _ i20x, /'"(O) = 0; 

f^ix) = 120x - 120, /^(O) = -120. 

Since/" (4) > 0 , /(4) = —256 is a minimum; and since ( 0 ) < 0, 

/(O) = 0 is a maximum. 

PROBLEMS 

1 . Examine for maxima and minima: 

(а) 2 / = — 4x3 + 1; 

( б ) y = x\x - 5)*; 

(c) y — x + cos X. 

2 . Find the minimiim of the function y x*, where x > 0 . 

Hwi: Consider the minimum of log y. Am. x = — 

e 

3. Show that x = 0 gives the minimum value of the function 

3 / = 6 * + 6 “* + 2 cos X. 

88 . Taylor’s Formula for Functions of Several Variables. 

Let fix, y) be a function of two variables x and y that is con¬ 
tinuous in the neighborhood of the point (a, h), and that has 
continuous partial derivatives, up to and including those of order 
n, in the vicinity of this point. 

If a new independent variable t is introduced with the aid of 
the relations 


(88-1) 


X — a-\- at, y = 6 + /3<. 
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where a and (3 are constants, there will result a function of the 
single variable t, namely, 

(88-2) F{t) s y) = /(a -f at, b + fit). 

Expanding F{t) with the aid of the Maclaurin formula gives 

(88-3) F{t) = F(0) -t- F'(0)< + + • • * + — 

where 0 < ^ < 1. 

It follows from (88-1) and (88-2) that* 


F'it) = Mx, y)^ + y) ^ 

= /»(®, y)a + fvi^, y)P- 

Calculating F''(t) and F'''(t) from this expression gives 

F"{t) = \fxx(x, y)(x -b fy^(x, y)$] ^ + [fsu(x, y)a -f- Jyy{x, y)ff\ ^ 
= ix,{x, 3 /)a* + 2/»„(a:, y)a^ +/w,(x, y)/3®, 

and 

F"'{t) = \S^{x, y)a^ -h 2S^„{x, y)a^ fyy.{x, y)^^] ^ 

“f" [/»a»(®) d" y')*^ “t" J/)^*] ^ 

= fxxx(p^} y)oL^ “t" ^fxxyQC) y)oC^P Wxyyi.^) “f" 

fvwix, y)^\ 

Higher order derivatives of F{t) can be obtained by con¬ 
tinuing this process, but the form is evident from those already 
obtained. S 3 unbolically expressed, 


■ (“ i + ^ I;) S + 

r%t, = (4 + 4)‘m y) - «• g + 8.V + 



3a/3» 


dy^ 


See Sec. 24. 
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Then 


i?(»> ^ ^ /(a:, y) ^ g + ^ 


where 


+ 

<?? 


dy 

+ C» ,0/3-1 . 

t- »-i axay—i ^ ^ ajr 
n\ 


r\{n — r)!’ 
Since ^ = 0 gives « = a and y — h, 


F^(0) — afaf{a, b) + Pfyio^, V)f • • • , 
Substituting these expressions in (88-3) gives 
F(t) = f(x, y) = f(a, b) + [ccMa, b) + ^fy (a, b)]l 
+ [«%*(«, b) + 2a/3/„(a, b) + 6)] J 

+ 3cc*Pf^(.a,b) + 3o/3%^(a,6) + p^yyy(a, 6)]|5 

where S. = + *“<.* + W. 

Since at = x — a and pt = y — b, the expansion becomes 
(88-4) f{x, y) = /(a, 5) 6) (a: — o) -|- /y(a, 6)(y — 6) 

+ b){x — o)* -1- ^*„(a, b) (x — o)(y — b) 

+ fvyM(y - by] 

-f • • • -H i2». 

This is Taylor’s expansion for a function f(x, y) about the point 
(o, 6). Another useful form of (88-4) is obtained by replacing 
X — a by A and y — 6 by A, so that x = a -f- A and y = b -^-k. 
Then, 

(88^) /(o -j- A, 6 -H A) = /(o, b) -1- /,(o, b)A /,(a, 6)A 

+ ^[/**(®j b)h* -b ^«,(o, 6)AA -b Syy{a, 6)A*] 

+ •••+«., 

where fi» = ^^A ^ + * ^) /(« + ^ 
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This formula is frequently written symbolically as 


/(a + i, 6 + 1) = J(a, b) + (h£ + k 1) 

+ + Rn- 

In particular, if the point (a, 6) is (0, 0), the formula (88-4) 
reads 

(88-6) fix, y) = /(O, 0) -b /.(O, 0)x -f- /„(0, 0)y 

+ 0)^* + 2/a»(0j 0)^2/ + fw(.0, 0)j/*] 

-f- • * • Rn, 

where Rn = ^ + 2/ fly), 0 < fl < 1. 

This development is known as the Maclaunn formula for functions 
of two variables. It is seen from (88-6) that the Maclaurin 
formula expresses the function f(x, y) in a series each term of 
which is a homogeneous polynomial in x and y. 

The procedure outlined above can be generalized easily to 
yield similar expansions for functions of more than two variables. 

Example. Obtain the expansion of tan~^ | about (1, 1) up 


to the third-degree terms: 



fix, y) 

= tan“^ -) 

X 

/(I, 1) 

= tan~i 1 

/.(*, y) 

y , 

*2 -1- y* 

Ml, 1) 

1 

2' 

/»(*. y) 

X 

X* + y^’ 

Ml, 1) 

1 

~ 2’ 

fxx(X} y) 

2xy 

(x» -1- y»)*’ 

/xx(l, 1) 

1 

2’ 

U(x, y) 

y2 — ^2 

(x* -f y*)*’ 

fxv(l} 1) 

= 0; 

/w(a:, y) 

—2xy 
(X* + y*)*’ 

fyy0‘) 1) 

X 

2 
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Then 

tan-i- + 

PROBLEMS 

1. Obtain the expansion for xy^ + cos xy about ^1, 0 up to the 
third-degree terms. 

2. Expand f(jx, y) = e**' at (1, 1), obtai ni ng three terms. 

3. Expand e* cos y at (0, 0) up to the fourth-degree terms. 

4. Show that for small values of x and y 

e^^siny = y + xy (approx.), 

and 


log (1 + y) = y + xy — ^ (approx*). 

5. Expand f{ Xj y) ~ x^ + x*y + I about (0, 1). 

6. Expand \/1 — x* — j/* about (0, 0) up to the third-d^ee terms. 

7. Show that the development obtained in Prob. 6 is identical with 
the binomial expansion of [1 — (x* + y*)f^. 

89. Maxima and Minima of Ftmctions of Several Variables. 

A function/(x, y) of two independent variables is said to have a 
maximum at (a, 5), if 

A/ = f(a + h,b + k) — /(a, h) < 0 

for all sufficiently small positive and negative values of h and k. 
It is said to attain a minimum at (a, b), if 

A/ ^ f (a+ h, b + k) — f(a, 6) > 0 

for all sufficiently small positive and negative values of h and fc. 

Let it be assumed that /(x, y) attains a maximum, (or a mini¬ 
mum) at (a, b). Then the fimction of a single variable /(x, b) 
must attain a maximum (or a minimum) at a, and its derivative, 
if it e^dsts, must vanish at x = a. Hence, a necessary condition 
for a maximum (or a minimum) is that 
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provided that this derivative exists. A similar consideration 
of the function f(fli y) leads to the conclusion that 

(89-2) ^ = 0 at y 

whenever the derivative exists. 

The equations (89-1) and (89-2) may be solved for a and h 
to yield the desired values. This discussion can be extended 
in an obvious way to include the case of functions of any number 
of independent variables, so that one can formulate a theorem. 

Theorem. A function of any number of independent variables 
xi, ^ 2 , • • • , attains a maximum or a minimum only for those 
values of the variables Xifor which 

df ^ Jl 

dX? dX2 ’ dXn 

either vanish simultaneously or cease to exist 

In order to establish a criterion for distin^ishing between a 
Tn5i.Yimnm and a minimum, note that Taylor’s formula gives 

(89-3) /(a + h,b + k) — /(a, b) - /r(a, b)h + fy(a, b)k 

+ bW + b)hk +/„(a, b)k^] + B, 

where 

Since the vanishing of the first derivatives is a necessary condi¬ 
tion for a maximum or a minimum, (89-3) becomes 

(89-4) Af^f{a + h,b + k)-f(a,b) 

- HlfUa, i)h^ + 2/*v(a, b)hk +/^(a, b)k^] + R, 

From the definition of a maximum it follows that Af < 0 ior 
sufficiently small numerical values of h and k, whereas for a 
minimum it is necessary to demand that Af > 0, 

In order to simplify the discussion of the determination of 
the sign of A/, introduce new independent variables by means 
of the relations 


h r cos <p, 

k r sin 
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Then (89-4) becomes 

(89-5) A/ cos* ^ + 2B sin ^ c(» <p + C sin* <p -b 

where 


A s f„(a, b), 

B = SxniO’, b), 

^ “ Swifl) ^)> 

and 4> is a function that is boimded for sufficiently small values 
of r. 

If A 5 >^ 0, (89-5) can be expressed in the more useful form 

(89-6) A/ -F (-^cosy+ -^smy)*-f(AC-jB*)sin*y ^ r^l 

21 A 3 1 


Consider the following possible cases: 

(a) AC — B* > 0. In this case the sign of 


(89-7) 


(A cos V) B sin ^i)* -b (AC — B*) an* ip 
A 


is the same as the sign of A. But, since $ is a bounded function 

T 

for sufficiently small values of r, the numerical value of can 

be made small as desired by choosing r sufficiently s m all. 
Accordingly, the sign of A/ will be determined by that of A. 
It follows then that the point (a, h) gives a maximum value of 
the function f(xj y) ii A <0, and a minimum value if A > 0. 

(6) AC — 5^ < 0. The first term in the numerator of 
(89-7) vanishes if 

A 

(89-8) tan (p = g. 


If ^ is one of the valu^ satisfying Eq. (89-8), then the 
numerator of (89-7) will be negative, and by choodng r sufficiently 
small, the first term in the bracket of (89-6) can be made to 
dominate the expression. Therefore, for tp = ^i. A/ will have 
the sign opposite to that of A. On the other hand, if ^ = 0, 
the ntunerator of (89-7) is positive, and hence, for = 0 and 
sufficiently small values of r the agn of is the same as that of A. 
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It follows that A/ does not maintain the same sign in the neighbor¬ 
hood of the point (a, 6), and consequently, this case gives neither 
a maxiinxim nor a minimum. 

(c) AC — - 0. If AC — vanishes, then the numerator 

of (89-7) is either positive or zero. Therefore, it is necessary 
to investigate the behavior of the function $ in order to be able 
to say anything about the sign of A/. Since the study of the 
fimction 4> is extremely involved and depends upon a very 
painstaking study of the higher derivatives of the function 
f(x, y), it will not be pursued here.* 

There remains to be considered the case when A = 0. But a 
reference to (89-5) shows that, since 

2B sin <p cos <p C sin“ <f> 

vanishes for some values of <p, this case also leads to the investigar 
tion of the function #. 

It is clear from the foregoing discussion that a maximum or a 
minimum will surely obtain if — AC <0, that is, if 


\dx dyj 


dx^ dy^ 


< 0 . 


!<- 


A maximum corresponds to the case in which both and ~ 

dx^ dy^ 

are negative, and a minimum to 

the case in which they are both 

positive. 

Example 1. A long piece of 
tin 12 in. wide is made into a 
trough by bending up the sides 
to form equal angles with the 
base (Fig. 74). Find the amount to be bent up and the angle 
of inclination of the sides that will make the carrying capacity 
a maximum. 

The volume will be a maximum if the area of the trapezoidal 
cross section is a maximum. The area is 

A = 12a; sin 5 — 2x® sin 0 -b x® sin 6 cos 6, 


-l2-2x - 
Fig. 74. 


* See €k)trRSAT, E. Cours d'analyse math^matique, vol. 1, 5th ed., pp. 
110-116. 
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since 12 — 2 x is the lower base, 12 — 2 a: + 2 a: cos d is the upper 
base, and a: sin 0 is the altitude. Then, 

= 12a: cos 6 — 2a:^ cos ^ + a;^ cos^ 6 — sin^ d 
= x(12 cos 0 — 2a: cos 6 + z cos^ 0 — x sin^ 0) 

and 

A 

— = 2 sin 0(6 — 2 x + X cos 0 ). 


— = 0 and — = 0 , if sin 0 0 and x = 0 , which, from physical 

considerations, cannot give a maximum. 

There remain to be satisfied 


— 2x + X cos 0 = 0 

and 

12 cos 0 — 2x cos 0 + X cos^ 0 — x sin^ 0 = 0. 

Solving the first equation for x and substituting in the second 
yields, upon simplification, 

cos 6 = ^ — 60°, and x = 4. 

Since physical considerations show that a maximum exists, 
X = 4 and 0 = 60° must give the maximum carrying capacity. 
Example 2. Fmd the maxima and minima of the surface 

^-S = 2c^. 

Now, 

— — 1 — — — _i 

dx c a*’ dy 

which vanish when x = y = 0. But 

^_ 1 _ 

Sx* a*c b^c 


c6* 


dx dy 


= 0 . 


Hence, D = ^ 5 ^’ consequently, there is no maximum 

or miuiiniun at X = 1 / = 0. The surface under consideration is a 
saddle-shaped surface called a hyperbolic 'paraboloid. The points 
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for which the first partial derivatives vanish and D > 0 are 
called minimax. The reason for this odd name appears from a 
consideration of the shape of the hyperbolic paraboloid near the 
origin of the coordinate system. The reader will benefit from 
sketching it in the vicinity of (0, 0, 0). 


PROBI^MS 

1. Divide a into three parts such that their product is a maTinmim 
Test by using the second derivative criterion. 

2. Find the volume of the largest rectangular parallelepiped that can 
he inscribed in the ellipsoid 


5 !+ 1 ^ + 1 * 

o* ^ ^ c* 


= 1 . 


3. Find the dimensions of the largest rectangular parallelepiped which 
has three faces in the coordinate planes and one vertex in the plane 


- + f + - 

a 0 c 


1 . 


4. A pentagonal frame is composed of a rectangle surmounted by an 
isosceles triangle. What are the dimensions for maximum area of the 
pentagon if the perimeter is given as P? 

6. A floating anchorage is designed with a body in the form of a right- 
circular cylinder with equal ends which are right-circular cones. If the 
volume is given, find the dimensions giving the minimum surface area. 

6. Given npointsP,* whose coordinates are (a;,*, 2 /,-, ;?,•), (f==l, 2, • • • ,w). 
Show that the coordinates of the point P(x, Vj z), such that the sum of 
the squares of the distances from P to the Pi is a minimum, are given by 


i-l t-l 


7. Let z - fix, y) be the equation of a surface which has a miniTniiTn at 
the point (0, 0). Then every plane containing the 0 -axis will intersect 
the surface in a curve which has a minimum at (0, 0). The converse of 
this statement is not true, as can be seen by examining the surface 

0 = (2/ - x^)iy ~ 2x*) 

in the neighborhood of the origin. Show that there exists no two- 
dimensiond neighborhood of the point (0, 0) in which the values of this 
function are all of the same sign. 
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90s Constrained Maxima and Minima. In a large number of 
practical and theoretical investigations it is required that a 
maximum or minimum value of a function be found when the 
variables are connected by some relation. Thus, it may be 
required to find a maximum of u = f(Xj y, z), where z, y, and z 
are connected by the relation y, z) = 0. The resulting 
maximum is called a constrained maximum. 

The method of obtaining mfl.YiTTn». and miniTTifl. described in 
the preceding section can be used to solve a problem of con¬ 
strained maxima and minima as follows: If the constraining 
relation <p(x, y, z) == 0 can be solved for one of the variables, 
say 2 , in terms of the remaining two variables, and if the resulting 
expression is substituted for js in u = /(a;, y, «), there will be 
obtained a function u = F(Zj y). The values of x and y that 
yield maxima and minima of u can be foimd by the methods of 
Sec. 89. However, the solution of ^(x, 2 ^, 2 ) = 0 for any one 
of the variables may be extremely difficult, and it is desirable to 
consider an ingenious device used by Lagrange. 

To avoid circumlocution the maximum and minimuTn values 
of a function of any number of variables will be called its extremal 
values. It follows from Sec. 89 that the necessary condition 
for the existence of an extremum of a differentiable function 
X 2 , • • • , x«) is the vanishing of the first partial derivatives 
of the function with respect to the independent variables Xi, 
• • • , Xn, Inasmuch as the differential of a function is 
defined as 


it is clear that df vanishes for those values of xi, x®, * • - , x,^ 
for which the function has extremal values. Conversely, since 
the variables x** are assumed to be independent, the vanishing 
of the differential is the necessary condition fpr an extremum. 

It is not difficult to see that even when some of the variables 
are not independent, the vanishing of the total differential is 
the necessary condition for an extremum. Thus, consider a 
function 


(90-1) 


tt = /(*, y, *), 
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where one of the variables, say 2, is connected with x and y 
by some constraining relation 

(90-2) <p(x, y, z) = 0. 


Regarding x and y as the independent variables, the. necessary 

, , • dw „ , 3 m „ 

conditions for an extremum give — ^ ^ ~ 


du _ df ■ df dz _ Q 
dx dx dz dx ' 

^ = — = 0 
dy dy 32 3y 

Then the total differential 


dx 


dx 4- 





dx + 


dz 

dy 


. y) = 0 , 


and, since the expression in the parenthesis is precisely dz, it 
follows that 




The total differential of the constraining relation (90-2) is 

(90-4) ^^dx + ^dy + ^dz = 0. 

Let this equation be multiplied by some undetermined mul¬ 
tiplier X and then added to (90-3). The result is 

(i+^ ll) + (I + ^ If) + (I+^ If) = 0- 

Now if X is so chosen that 


dx^ dx 

dy ^'^dy 

d2 ^ 32 
f>(x, V, *) 


0 , 

0 , 

0 , 

0 , 


(90-5) 
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then the necessary condition for an extremum of (90-1) will 
sxirely be satisfied. 

Thus, in order to determine the extremal values of (90-1), 
it is merely necessary to obtain the solution of the system of 
equations (90-5) for the four unknowns x, y, 2, and X. The 
multiplier X is called a Lagrangian multiplier. 

Example 1. Find the maximum and the minimum distances 
from the origin to the curve 

^ x ^ + 6x2/ + 5 y ^ — 8 = 0. 

The problem here is to determine the extremal values of 

f(x, y) =x^ + 

subject to the condition 

<p(x, y) = bx^ -f bxy + — 8 = 0. 

The equations (90-5) in this case become 

2x + X(10a: + 62/) = 0, 

2y + X(6x + lOy) = 0, 

5x^ + 6xy + 5y^ — 8 = 0. 

Multiplying the first of these equations by y and the second by x, 
and then subtracting gives 

6X(2/2 - x^) = 0, 

so that y ±x. Substituting these values of ^ in the third 
equation gives two equations for the determination of x, namely, 

2x^ = 1 and 2. 

The first of these gives f ^ x^ + y^ 1 and the second gives 
f = A. Obviously, the first value is a minimum, 

whereas the second is a maximum. The curve is an ellipse 
of semiaxes 2 and 1 whose major axis makes an angle of 45® 
with the x-axis. 

Example 2. Find the dimensions of the rectangular box, with¬ 
out a top, of maximum capacity whose surface is 108 sq. in. 

The function to be maximized is 


f(x, y, z) = xgz, 
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subject to the condition. 

(90-6) xy + 2xz -f 2yz = 108. 

The first three of the equations (90-6) become 

( ye ■¥ X(j/ + 2z) = 0, 

(90-7) < XZ + \(x + 2z) = 0, 

(ry + X(2r + 2y) = 0. 

In order to solve these equations, multiply the first by x, the 
second by y, and the last by z, and add. There results 

'K{2xy -f 4rz H- 43/z) -1- Zxyz = 0, 
or 

\{xy + 2a:z + 2yz) + %xyz = 0. 

Substituting from (90-6) gives 

108X -f ^xyz = 0, 
or 

_ x>yz 
X- 

Substituting this value of X in (90-7) and dividing out common 
factors gives 

l-^(j/ + 2z) =0, 

1 - ^(x + 2z) 0, 

1 - ^(2x -f- 2y) = 0. 

From the first two of these equations it is evident that x — y, 

18 

The substitution of a; = y in the third equation gives 21 = — 

y 

Substituting for y and z in the first equation yields a; == 6. Thus 
a; = 6, y = 6, and z Z give the desired dimensions. 

PROBIJiMS 

1. Work Probs. 1, 2, and 3 of Sec. 89 by using Lagrangian multipliers. 

2. Prove that the point of intersection of the medians of a trian^e 
possesses the property that the sum of the squares of its distances from 
the vertices is a minimum. 
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3. Find the maxiinmn and the TniniTTinm of the sum of the angles 
made by a line from the origin with (a) the coordinate axes of a cartesian 
system; (5) the coordinate planes. 

4, Find the maximum distance from the origin to (a) the folium of 
Descartes + y® — 3axy = 0; (6) the ellipse 

llx^ + %xy + - 12a; - 12y - 12 = 0. 

6. Find the shortest distance from the origin to the plane 

ax + by + cz d. 


91. Lagrange’s Multipliers. The discussion of the preceding 
section, showing that the vanishing of the total differential is 
the necessary condition for an extremum, is perfectly general 
and can be extended immediately to the function/(a;i,a; 2 , • • • ,Xn) 
of n variables, several of which may not be independent. 

Thus, consider a function 

(91-1) w = f(x, y, z, u), 


and let the constraining relations be 


(91-2) 


y, z, u) = 0 , 
Vi(x, y, z, u) = 0. 


The relations (91-2) will be thought of as defining the variables 
z and u as functions of the independent variables x and y. Then 
the necessary conditions for an extremum are 


or 



and 


dw 


0 , 


dw _ df . df dz ■ df du 
dx ~ dx dzdx dudx 
dw _ df . df dz . df du 
dy ~ dy'^ dzdy dudy 


Multipl 3 dng the first of these equations by dx, the second by 
dy, and then adding, 


( 91 - 3 ) = = 
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The constraining relations (91-2) give 


(91-4) 




0 , 




Multiplying the first of the equations (91-4) by Xi and the second 
by \i, and adding the resulting equations to (91-3), 




J_ \ _L \ 

■T-T Al -T-r A2 

dx dx ox 




-f 




4_ \ 4- \ 


du = 0. 


This equation is satisfied if Xi and X 2 are so chosen that 

JL\ 4- \ - n 


(91-6) 


1 ^/ 4- \ 4- X 

1^-hX,—4-X,-^ 


0 , 


1 ^/ 4 - X 4 - X - n 

's+ ’"■*+’‘■to - 
f+ x.^‘ + x,^-o. 

du du du 


The four equations (91-5), together with the two constraining 
relations (91-2), can be used to determine the values of 
Zj Uy Xi, and X 2 , which give extremal values of (91-1). 

The procedure just outlined can be extended in an obvious 
way to cover the case of more than two constraining relations 
and more than four variables. This discussion leads to the 
following rule: 

Rule. In order to determine the extremal values of a function 
(91-6) f(Xl, Z2, • • ■ , Xn) 

whose variables are subjected to m constraining relations 
(91-7) ^i(xi} X2f * * * ) 3Jn) ~ 0, (^ = 1, 2, • • • , m')j 

form the function 


F =f + ]^Xi <pif 
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and delerrnine the parameters X,- and the values of Xi, Xi, , x^ 
from the n equations 


= O'=1,2, ,n), 

and the m equations (91-7). 

As an illustration, consider the problem of determining the 
maximum and the minimum distances from the origin to the 
curve of intersection of the ellipsoid 


-4-^ + - 

^^2 1- 62 -f c 2 


1 


with the plane 

Ax + By + Cz = 0. 

The square of the distance from the origin to any point 
(x, y, z) is 

/ = X* + 

and it is necessary to find the extremal values of this function 
when the point (x, y, z) is common to the ellipsoid and the plane. 
The constraining relations are, therefore, 

(a) VI = ^ + p + ^ - 1 - 0. 


and 

(b) (p 2 ^ Ax + By + Cz = 0. 

The function F = / + + ^ 2^2 is, in this case, 

+ 2 \ 2 {Ax + By + Cz), 

where the factor of 2 is introduced in the last term for con¬ 
venience. Equations (91-8) then become 

X + Xi— 2 “b Xz^ = 0, 

d 

y = 0 , 

z + Xi^ + XzC 0. 


(c) 
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These equations, together with (a) and (6), give five equations 
for the determination of the five unknowns x, y, z, Xi, and Xj. 
If the first, second, and third of equations (c) are multiplied by 
X, y, and 2 , respectively, and then added, there results 

x^ + y^ + z^ + Xi(g + + 1 ) + + ^y + = 0- 

Making use of (a) and (&), it is evident that 

Xi == - (x^ + y^ + z^) = -/. 

Setting this value of Xi in (c) and solving for x, and z, 

x(l-^+\tA=Q, or 

^(1 ~ ^) + 

2(1 - 1) + 

When these values of Xj t/, and z are substituted in (6) one obtains 

, CV _ ^ 

from which / can be readily determined by solving the quadratic 
equation in /. 


X = 


y = - 


z = 


X^Aa^ 

X^Bb^ 

b^-f 

X2CC2 


PROBLEMS 

1. Find the point P, in the plane of the triangle ABC^ for which the 
sum of the distances from the vertices is a minimum.* 

2. Find the triangle of minimum perimeter which can be inscribed 
in a given triangle. 

* See E.Goursat^s Mathematical Analysis, voL 1, English ed., p. 130, for a 
detailed discussion of this interesting problem. 



CHAPTER X 
IMPROPER INTEGRALS 


In de finin g the definite integral, it is assumed that 

the function/(x) remains bounded in the interval (o, 6), and that 
the end points a and h of the interval are finite. If either (or 
both) of these assumptions is not satisfied it is necessary to 


attach a new interpretation to the symbol fix) dx. If the 

function fix) becomes infinite in the interval o :< x 5, or if 
the limits of integration become infinit e, then the symbol 


dx is called an improper integral. It will be seen that 


the improper integrals are defined as limits of certain functions 
which arise from a consideration of ordinary definite integrals. 

92. Integral with Infinite Limit. If the function fix) is 
bounded* and integrable for x ^ a, then the symbol 


(92-1) 


"fix) dx 


is defined by the equation 


If this limit exists, then the integral (92-1) is said to convoke; 
otherwise it is called a divergent iiUegrd. The divergent integral 

can arise in two ways. It may happen that J^fix) dx becomes 

infinite with h, or it may be that this integral oscillates without 
approaching any limit. Thus, 

* The definition of an int^rable function /(x) (Sec. 35) demands that 
fix) be bounded; hence, the statement that the fimctaon is hounded and 
integraUe is redundant. However, some authors extend the class of func¬ 
tions integrable in the sense of Biemann to include those unbounded func¬ 
tions whose impropw integrtds exist (see Sec. 94). The word hounded is 
inserted here to preclude the possibility of interpreting the term integriMe 
function in the extwded smise. 
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f "4= . lini - Em (2V5 - 2VS). 

The expression within the parentheses becomes infinite with h. 
On the other hand, for 

J '*“ sin X dr = lim sin xdx = lim (cos a — cos 6) 


the expression in parentheses oscillates as h is increased and does 
not approach any limit. Both of these integrals are called 
divergent. However, 


xdx 

— lim 1 
^-►oo J 

X dx 

+ 1)* 

a (X^ + 1)* 


lim 7 

1 


L(o* + i)* 

the value 




1 

(b^ + ly 




4(a* + !)*■ 

Sinailarly, 


is defined as the limit of the function dx when a becomes 

negatively infinite, so that 


J{x) dx = lim 


It may happen that the integral J^/(*) d,x of a bounded function 
f(x) exists for all finite values of a and b; in that case the symbol 

dx 

is understood to mean 

(92-2) y J(x) dx+f “fix) dx, 

where c is any real number. 

It is clear that a study of an improper integral with a con¬ 
tinuous integrand reduces to a study of the behavior of the 
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limit of the function F{x) as co^ where F(x) = 

The conditions under which a function F{x) converges to a 
limit have been discussed in Chap. I, and a direct application 
of the fundamental principle of convergence to a limit furnishes 
the following theorem. 

Theorem. !• A necessary and sufficient condition that J* */(a;) dx 

he convergent is that, for any arbitrarily small positive nurnber c, 
there exist a number N such that 


£fix) dx 


< € 


for all values of p and q which both exceed N. 

However, the application of Theorem 1 to the determination 
of the convergence of a particular integral is likely to be difi&cult. 
For this reason some simple practical tests are developed with 
the aid of Theorem 1 and the following theorem. 

Theorem 2. If f(x) is continuous for x a and ‘l/(a:)l dx 

exists, then fffi^) ^ odso exists. The function f(x) is then said to 

be absolutely integroble over the infinite interval. 

In order to prove this statement, write 

S{x) = [/(x) + l/(a:)l] - \f{x)\. 


Then 

(92-3) f^ix) dx = + l/(a:)|] dx - f\f{x) 1 dx. 

By hypothesis the second integral in the right-hand member of 
(92-3) converges when 6 oo. But 

0</(x) + i/(x)l<2|/(x)l; 


hence 

0 ^ f[f{=») + l/(^)l] dx ^ £2\f(x)\ dx. 

Since the integral r '2\f(x)\ dx is convergent as 5 ^ ? it follows 

that the first integral in the right-hand member of (92-3) also 
converges. 

The converse of Theorem 2 is not true. The integral of /(a?) 
may converge over an infinite interval when the integral of 
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|/(x)l does not converge. This corresponds to the situation 
in infinite series when a series converges conditionally. 

As an instance of such behavior consider the integral* 


(92-4) 



dx, 


which is convergent but not absolutely convergent. The con¬ 
vergence of the integral (92-4) will be established with the aid of 
Theorem 1. 

It follows from the second mean-value theorem for integrals 
(Sec. 37) that 


r dx = - r sin X dx -\r~\ sin x dx, 

Jp X vJp gJt 

where 0 < p ^ ^ ^ q. But 

sin a: da: ^2 

Consequently, 


and 


sin X dx\ ^ 2. 


r* 8in X 

Jp ® 


da;| ^ 2 
< 2 
= i. 

P 


i+0 


Now if any e > 0 is prescribed, the inequality 

f ® da:| < « 

Jp * 

will surely be satisfied for all values of p and q that are greater 
4 

than iV = — Thus, the integral (92-4) is convergent, f 


* It is customary to define the value of 


sin X 


at X 


0 as unity, so that 


CTTl X . 

-is a continuous function. 

X 


t It will be shown in Sec. 97 that 


/• 00 . 

I ^ 
Jo « 


dx 


AT 

2 
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4 In order to prove that 
(92-5) 


j; 


sin x\ 


dx 


diverges, note that for any positive integral value of k 


Jo Jo X 


dx + 


sin X 

X 


dx + 


J. 


(*+l)ir| 


[sin x\ 

X 


dx 


21 

n *0 


(«+l)x| 


isin x\ 


dx. 


Now, for n ^ 0, 
f (n+l) 

(92-6) 

Jnr 


Sin x\ 


dx 




|sm»| _2 

(n-M)x“® (n-f-Dx 

1 . 


since the minimum value of - in the interval [nx, (n + l)x] 

X 


is 


(n + l)7r 

k 


It follows that 


2X 

n -*0 


C«+l)x| 


sm x\ 


dx 


xV ^ 2 ^ 3 ^ ^ fc + 1/ 


and, since the series in the right-hand member of this inequality 
diverges as ft oo, the integral (92-5) is also divergent. 

It may be remarked that the function /(x) need not approach 

zero as X —> 00 in order that the integral /(x) dx be convergent. 

Consider, for example, the integral 


^*sin x^ dx, 

and assume that it can be written as the sum of a seri^ of inte¬ 
grals, namely, 


(92-7) 


X 


'sin X* dx = V sin a:® dx. 
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The series in the right-hand member of (92-7) is readily shown to 
be convergent, but the integrand of (92-7) obviously does not 
approach zero as a: . 

In order to prove the convergence of the series, let the variable 
X be changed by the substitution 


Then 

J *V(n+i)T ’■gin (z -|- m) 

sin dx - >.; - ■ 

-1 

It is clear from this form of the general term of the series that 
the series in the right-hand member of (92-7) is alternating and 



decreasing in such a way that the limit of the nth term as 
n —> 00 is zero. Consequently, the series and, hence, the integral 
(92-7) converge. 

The question of the legitimacy of the iniBnite series representa¬ 


tion (92-7) of the integral sin dx will be settled in Sec. 96, 

but it is not at all necessary to resort to this method of establish¬ 
ing the convergence. In fact, a substitution of x^ y leads to 


sin 2 / 

a consideration of the integral I —~ dy, which is readily 

Jo Vy 

shown to be convergent.* 


* See the illustration at the end of Sec, 93 and Example 2 of Sec. 95. 
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The reason for the convergence of this integral may be seen 
from geometrical considerations (Fig. 75). The areas bounded 
by the successive arches oiy = sin decrease with the increase in 
71, because the difference of consecutive roots, \^(n + 1 )t — 
of sin tends to zero when n oo ^ while the height 

of each arch always remains equal to unity. 

93, Tests for Convergence of Integrals with Infinite Limits. 
This section contains some practical tests for determining the 

convergence of the integral f{x) dx, where/(r) is a continuous 

function for all values of x ^ a. It will be assumed throughout 
this section that a is a positive number. This entails no loss 

of generality, since the integral f dx. where the lower 

Jao 

limit ao is negative, can be written as the sum of two integrals, 
namely 

f f(x) dx = fy(x) dx + f“f(x) dx, 

«/ao tJco tJa 

where a is a positive number. 

Theorem 1. If f(x) is continuous for x > a and there exists a 
positive number A such that 

\f{x)x^\ < A when x ^ a, 
then dx converges absolutely if h > 1. If |/(x)x*| ^ A 

and fc ^ 1, then the integral f(x) dx diverges. 

The proof of the theorem is simple. For, if 

then 

(93-1) £ |/(a:)I dx < I dx. 

But 

(93-2) if 

and, if fc > 1, the right-hand member of (93-2) approaches the 
limit when 6 —> oo. Thus, the integral on the 
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right of the inequality (93-1) exists, and, since r )m\dx is 
an increasing function of x, the integral dx exists. It 

follows from Theorem 2, Sec. 92, that J^"‘f(x) dx exists. 

The proof of the second part of the theorem js just as easy. 


Therefore, 






X ^ a. 


dx ^ A 


A 

But if |/(a:)| ^ then/(a:) cannot change sign for a; ^ a, since 
fix) is a continuous function. Suppose that fix) > 0; then 

|/(a;)| dx = J fix) dx ^ A x '^dx. 



= log 6 - log a, ji k = 1, 

which diverges as & -» «. Consequently, £ "fix) dx diverges. 
If f{x) < 0 for X a, then 

j[V(a:)| dx = -£fix) dx, 

and the assertion that £ fix) dx diverges follows immediately 
from the proof for the case, when/(*) > 0. 

This theorem is capable of a simple geometrical interpretation. 

If !/(«)! <-^> then the graph of the function y = fix) lies 
between the graphs of y = (Kg. 76). Consequently, 
the area under the curve y = bounded by the ordinates 
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X = a and x = b and the as-axis, is greater than the area under 
the curve y = |/(a:)j, so that 

i/(*)lda; < j^^dx. 

If the integral on the right of this inequality is convergent, 
then the integral on the left will surely converge. 



fix) S: ^ for a; ^ a, 


then the area under the curve y = f(x) will not be less than that 
under y = so that 

j^fix)dx ^ 

A particularly useful form of Theorem 1 appears when fix) 
is such a function that lim a^/(x) exists. In such a ease Theorem 1 

g' > po 

can be phrased as follows: 

Corollary. If lim cc^fix) = L, where fc > 1, ^ten f(x)dx 
converges absolutely. 
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I/lim a^/(a:) = L 9 ^ Q and k ^ 1, then dx diverges. 

As an illustration of the application of this corollary consider 


Since 



dx 

(1 + x*)^ 


lim x' 


1 

(1 + x^)^ 



= 1 , 


it follows that the given integral is convergent. 

The reader will have no difficulty in deducing, with the aid 
of the corollary, the following useful theorem. 

Theorem 2. If f(x) = where Pi{x) and Pt{x) are poly¬ 

nomials in X and Pi(x) 9^ 0 for x ^ a, then the necessary and 

X dO 

f(x) dx converge is that the degree of 

Pfi(x) exceed the degree of Pi(x) by at least two. 

Theorem 3. If f{x) is continmus for x a and there exists a 
positive number A such that \e^^f(x)\ < A when x ^ a^ then 


dx converges absolutely if > 0. If ^ A, 

then f{x) dx diverges if k ^ 0 . 

The proof of this theorem follows by using the argument 
employed in establishing Theorem 1, and by noting that 





if k ^ 0 , 

if Jfc = 0* 


Corollary. If lim f(x)e^^L and k > 0, then f'^fix) dx 
converges absolutely. 

If Km/(a;)e^ = 1/ 5*^ 0 and k S 0, then ff(x) dx diverges. 

X~~* 00 •/<» 

As an illustration consider 


f 


e-^dx. 


Since 


lim. = lim = 0, 
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it follows that the given integral is convergent. 

Theorem 4. If ^(x) is a monotone function whuh approaches a 
finite limit as x increases indefinitely, then 

/W t(x) dx 

mU converge if “fix) dx converges. 

The proof of this theorem follows from Theorem 1, See. 92, 
with the aid of the second mean-value theorem for integrals 

(Sec. 37). The convergence of requires that there 

exist a number N such that when p and q are any numbers 
greater than N, then 

But 

\f^<p(x)f{x) dx| = ^<p(p)j‘Jf(x) dx + <p{q)f^f(x) da:| 

^ H “*■ ‘^*1' 

where p, and q are all greater than N, Then, if L is the li m it 
approached by <p(x) as x increases, and if ifc is the laxgj&r of \L\ 
and \<p((i)\j it is evident that 

1 ^(P)l • H + dx\<2ek= d. 

Therefore, 

\^J‘%(x)f(x) dr] < e', 

if p and q are any numbers greater than N. 

By a similar argument it can be shown that if <p(x) is a mono¬ 
tone function which approaches zero as x increases indefimtely, 

then Jj‘<pix)f(x) dx converges if dx remains bounded 

as 6 increases indefinitely. It should be noticed that this state- 
ment does not require that J^ix) dx converge to a limit as 6 
is increased. 

For example, the integral 

f ^sin X , 

j. *■ 
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where Jk > 0, can be written as 


§03 




-4 sin X dx. 


Since -4 is a monotone function which approaches zero as x 
x^ 

increases, and since r sin xdx — cos 1 — cos 6 which oscillates 

as h increases, it follows that the given integral is convergent. 
The convergence of this integral was discussed in Sec. 92 for the 
case in which ft = 1. 

As another example, consider 

^ dx. 

This integral can be written as 


X' 


-»*+ 2 a- 2 ! 


dx = 


o 


Now c »• is a monotone-increasing function which approaches 
the limit 1 as a; increases, and dx was shown to converge. 

Hence, 

fje-ir-t)\dx 

is convergent. 

PROBLEMS 

Test the following integrals for convergence or divergence: 

f ^^' cos X - 

j. 


1 . 

2 . 

3. 

4. 


f- 

Ji X 


dx 


:VT+1 


sdx 

0 \/2TT* 

i 


sin z dr. 


7 

a 

9. 

10 


sin X 


'-X' 


1 

e* 


/• 00 . 

, I r sm z , 

'• Jo IT^^- 

r^-^dx. 

ji i+»* 

/• 00 • 

I sin X , 

I —~ 

Jo 1 + a? 


dx. 


(1 + xy 

sin X 


“■X 


dx 


dx. 


12 . 


'o vT+x^ 

r* dx 

Jo 1 + »** 
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94. Integrals in Which the Integrand Becomes Infinite. If 

f{x) becomes infinite for some value of x = c, where a <c <b, 
then, by definition, 

(94-1) rV(^) r* dx + lim P f(x) dx, 

and the integral is said to exist if the limits of the two integrals on 
the right-hand side of (94-1) exist. In case f(x) becomes infinite 
at ic == a, then, by definition, 

Cj{x) dx = lim P J{x) dXf 

15—,-0 e/o+e 

and if f{x) becomes infinite at x = 6, 

*f{x) dx. 

It may be observed that, since 

lim P f(x) dx = lim [F(6) — F(a -f e)], 

4—^0 ( r -»-0 

where F(x) is the indefinite integral of fix), the integral con¬ 
verges if lim F(a -t- «) exists. If the indefinite integral can 

4^—►O 

be found, the evaluation of the definite integral is accomplished 
in the process of determining its convergence. 

It is important to note that the variables €i and €2 in the 
definition (94-1) are assumed to approach zero independently 
of one another. The same variable € is used occasionally in 
the definition, so that 

(94-2) dx s lim or- '/(*) dx + fX,mdx). 

But the limit in (94-2) may exist when the limits in (94-1) do 
not exist. If the limit in (94-2) exists and is equal to L, then 
the value L is called Cauchy’s 'principal value of the integral 

dx. 

If fix) becomes infinite at both end points of the interval 
but remains bounded within (a, h), then the integral of fix) 
is defined by the equation 

Pjix) dx = ^fim 
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where each of the limits on the right must exist if the integral 
dx is to converge. 

The definitions given above can be extended in an obvious way 
to include the case where /(a:) has any finite number of dis¬ 
continuities in the interval (a, 6 ). 

Example 1. 

r^dx y C^dx r 

Hence, the integral does not exist. 

Example 2. 

f- lim - lim (-Wi + 2V2Y 

Jo v2 — X Jo v2 — a: r-*o \ / 

and thus the integral converges to 2 -\/ 2 - 
Example 3. 

xdx _xdx , f*® X dx 

Jo (** - IP ~ iiS'o jo (x^ - ip - ip 


r xd 
Jo - 


ip ^ojo (X^ - ip Ji+..(a;* - ip 




+ hm |( 2 ) - |(4 + 26 ,)H 


Therefore the given integral is convergent to 
Example 4. 

and therefore, the given integral does not converge. But if 
62 = €i 5 = €, then 

/.‘i-ss(X‘j+r§) 

/ I J 

-f is equal to zero. 

~lX 
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It is clear from the foregoing that the determination of the 
convergence of improper integrals, with discontinuous integrands 
is reduced to the study of the behavior of the limit of the function 
F(e) as e 0, where F{e) is of the form 


From the definition of the limit of a function (Sec. 8 ) and from 
the fundamental principle of convergence (Sec. 5 ), it follows that: 

The necessary and sufficient condition that lim Fit) exist is that 

«—> 0 + ^ 

for any preaasigned positive number rj, one can find a number d 
such that 


< rf 

whenever 0 < €2 < €i < 5. 

Recalling the definition of Fie) one can state the following 
theorem: 

Theorem. A necessary and sufficient condition for the conver¬ 
gence of the integral 

dx 

whose integrand becomes infinite at x == a is that for any pre¬ 
assigned number 97 > 0 , one can find a positive number 8 such 
that 

whenever 0 < €2 < €1 < 5. 

It follows from this theorem that if £ |/(a;)l dx is convergent, 

then f^ix) dx will surely converge. The converse of this 
statement, however, is not true. For, consider the integral 

fUi 

Jo 


Setting a; = - gives the integral 
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which was shown to be convergent, but not absolutely convergent 
(see Sec. 92). 

96. Tests for Convergence of Integrals Whose Integrands 
Become Infinite. Corresponding to the tests given in Sec. 93 for 
the convergence of integrals with infinite limits, one can develop 
tests for the convergence of integrals whose integrands become 
infini te in the interval of integration. One of these tests is 
given next. 

Theorem. If f(x) is continuous for a <x Sh and there exists a 
positive number A such that |/(a:)(a: — o)*! < A for 0 < k < 1 and 

a < X ^ b, then fix) dx is absolutely convergent. 

If \fix)ix — a)*l > A for h 1 and a < x S b, then J^fi^t) dx 
is divergent. 

The proof of this theorem is entirely similar to that of Theorem 
1, Sec. 93. It is only necessary to observe that 


r dx 
Jaix- 


exists if fc < 1 and does not exist if fc ^ 1. 

. Corollary. If lim {x — a)’‘f(x) = L, then f fix) dx converges 

a:-*a+ 

absolutely if 0 < k < 1. 

If lim ix — a)'‘fix) = L 5»s 0, then Pfix) dx diverges ifk^l. 
Example 1. Consider 


in'* - 


lim -- = ——> 

1+ va:* + a: + 1. V3 


it follows that the given integral is convergent. 
Example 2. Consider 


J ' ‘sin a: , ^ . 

„ »> »• 


Sin X sin X 


X 


>.n—1 
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But, since lim ■ 


= 1, it follows that 


x-~*0 ^ X'-^O \ X 

= lim 

a ;—+0 



This limit will exist provided that n — 1 )k. Thus, if » < 2, 

the integral is convergent, and if n ^ 2, the integral is divergent. 
Example 3. Consider 



sm X 

Since lim a:* log a: = 0 if > 0, and lim-= 1, it is evident 

*■“►0 x~-*’0 ^ 

that lim x’’ log sin a; = 0, when A > 0. Consequently the integral 
converges. 

PROBLEMS 

1. Test the following integrals for convergence or divergence: 
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2. Prove the convergence of the integrals 


(a) S = 


X 


°Vo» - e'h:^ 

0 -y/a® — 


dx, 


0 <e <1; 
b > 

e 


0 < e < 1. 


These integrals are known as the elliptic integrals of the second and first 
kinds, respectively. 

3. Prove the convergence of the integrals 


» 


r dS n . 

I . .= —='.:== =:y 0<e<l; 

Jo -v/l — sin* 6 




\/l — e* sin* 6 


0 < e < 1. 


Set X = sin 0, and use the results of Prob. 2. 

4. If P(x) and Q(x) are relatively prime polynomials, show that 
^P(x) 


£ 




dx diverges whenever a root of Q(x) falls in the interval 


a ^ X ^ 6 . 


96. Operations with Improper Integrals. Inasmuch as the 
improper integrals are defined as the limits of certain functions, 
it is patural to inquire whether it is permissible to perform the 
same operations on improper integrals as are familiar in the case of 
finite integrals. It is clear from a consideration of the examples 
in Sec. 92 that the behavior of some improper integrals is closely 
analogous to that of infinite series, and this fact alone is sufficient 
to indicate the need of caution. 

It is true that the equation 

J^cfix) dx = cjy(x) dx, 

when c is a constant, is valid, even when the integrals are 
improper, since in applying the linoit process, the constant c can 
he placed either inside or outside the limit sign. 

The equation 

(96-1) +Mx)] dx = £Mx) dx + fy,(x) dx 

however, is not always true. It may be that <f>(x) = /i(x) + /,(x) 
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is a function whose integral converges, whereas the integrals 
of fi(x) and /^(x) are divergent. Thus, 

X'H)- 

is divergent, as is 

r' dx 

X 

but 

XXA-;)- 

is convergent. However, if any two of the integrals in (96-1) 
converge, then the third integral also converges, and Eq. (96-1) 
is true. Similarly, if any two of the expressions' in the formula 
for integration by parts, 

(96-2) £fi{x)ft(x) dx == /i(x)/ 2 (a:)j^ - dx, 

exist, then the third expression also exists and the relation (96-2) 
is valid. 

Matters are considerably more involved when one considers 
the differentiation and integration of improper integrals with 
respect to a parameter, and it is necessary to impose more severe 
restrictions on the integrands than was the case with the ordinary 
integrals. Thus, consider an integral containing a parameter, 
namely, 

(96-3) F(a) ~ ^ ^ where a > 0. 

If the differentiation under the integral sign be performed 
formally there results the integral 



which is divergent and consequently does not represent the 
function F'(a).* 


‘ It may be remarked that the function defined by the integral (96-3) is a 
constant. For. setting « ■= ocr gives dz, 'which is independent of a. 


, which is independent of a. 


Consequently, F (a) — 6. 
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The diflSculty encountered here is essentially of the same 
sort as that appearing in the diflferentiation of series term by 
term. In fact, it idll be shown next that a study of the con¬ 
vergent improper integrals of the form 

(96-4) F(oc) = a) dx, 

where /(x, a) is a continuous function for a; ^ a and for every 
value of a in the interval ao ^ a ^ cth equivalent to the study 
of a series of integrals. 

Let 

a ^ ax < az < az < • • • < • 

be any increasing sequence of numbers such that 

Jim Un = 00 . 

n—+ « 

Then the integral (96-4) can be written as an infinite series of 
integrals, namely,* 

(96-5) f ct) dx = p* /(a:, a) dx + py(x, a) dx ^ 

+ c^) dx-h • •. 

•/On 

n-1 

Now each term of the series in the right-hand member of (96-5) is 
a continuous function, so that 

ee 

(96-6) f{x, a) dx = ]^«.(«), 

n-l 

* It is important to note that the requirement that the integral be con¬ 
vergent is essential if one is to reduce the study of the integral to that of the 

series. For example, sin a; da; is divergent, but the series 

«a 

“X **** ■*"Xr + ' • • + sin «+ • . . 


has its sum equal to zero. 


«0 

Accordingly, r sin a; da; 3^ 2/^ 


91-0 



where 
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“) (ao a ^ ai). 

00 

If the series «„(«) is uniformly convergent, then the function 

n>*l 

Fia) wUl surely be continuous. Accordingly, one can borrow 
the terminology of infinite series and say that the integral (96-4) 
will define a continuous function if it is uniformly convergent. 
This, of course, means that the series (96-6), which represents 
the integral, is uniformly convergent. Inasmuch as the con¬ 
struction of the series (96-6) is not unique, it is more convenient 
to define the uniform convergence of the integral (96-4) as foUows: 

Definition, The integral /: f(x, a) dx cmverges-uniformly in 

the interval ao ^ a ai if, corresponding to any t > Q, one can 
find a number N, independent of a, such that 

"fix, a) drj < 6 

for every value of a in the interval (ao, ai,) whenever p ^ N. 

M the integral f(x, a) dx converges uniformly, then the 

series (96-6) will also converge uniformly, so that for any e > 0, 
one can find a number N independent of a such that ' 

•Kn ^M<+i(a)| < €, 

|<-n 

whenever n"^ N. 

As in the case of uniform convergence of series, the definition 
does not provide a useful test for uniform convergence. A 
simpler test for uniform convergence of integrals foUows directly 
from the Weierstrass test for series. 

Weierstrass Test for Integrals. If q>{x) is a positive and 
continuous function for x ^ N, and if \f(x, a)| S <p{x) for 
ao ^ a ^ ai and x ^ N, then 

fjf f(x, a) dx 
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is uniformly and absolutely convergent for every a in the interval 
{at, ai) provided that dx converges. 

It was remarked earlier that the function F{a), defined by the 
integral (96-4), will surely be continuous in the closed interval 
(ao, cci) if the integral converges uniformly. 

XJsing the notion of uniform convergence of improper integrals 
and noting Theorems 2 and 3, Sec. 70, it is easy to establish the 
following sufficient condition for integrating and differentiating 
imder the integral sign. 

Theorem. Letffx, a) be continuous in x and a for ao ^ a aj 
and for all values of x ^ a; then 

F{a) s jT "/(x, a) dx 

can be integrated under the integral sign with respect to a in any 
interval (j3i, ^ 2 ) contained in (ao, ai) to yield 

da = £ 

if I'f(ic, a) dx is uniformly convergent in (ao, ai). 

Moreovery if J converges uniformly for every value 


dx converges uniformly for every value 


of a in the interval (ao, cci) and fa is continuousj then 




Some appKcations of this theorem to the evaluation of improper 
integrals are indicated in the next section. 

PROBLEMS 

1. Establish the uniform convergence of the following integrals: 

{a) cos ax dx; 

Q)) a > 0; 

(c) e"*"* x^dx, a > 0, 

2. Integrate cob x® dx, (b > a), by parts and obtain 


r coBx^dx ^‘^Bmb* - ~ sin a» + ^ f dx. 
Ja 2b 2a 2Ja X* 
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Deduce from the result the convergence of the integral £ “ cos dx. 

3. Use integration by parts to show that £ “cos a: log a dr diverges. 

4. Use integration by parts to show that^'cos r log r dr converges to 

-f‘^*dr. 

Jo « 

97. Evaluation of Improper Integrals. This section is con¬ 
cerned with the evaluation of several improper integrals that 
cannot be calculated directly with the aid of the fundamental 
theorem of the integral calculus. It will be seen that the theorem 
of the preceding section plays ah important part in nearly all 
the examples considered below. 

Example 1. Let it be required to evaluate the probability 
integral 

(97-1) ~ X 

The convergence of this integral has already been established, in 
Sec. 93, but it will be profitable to attack the problem in a 
different way which will lead to an estimate of the magnitude of 
the number J, 

Now 

^ e-^'dx = £e^^*dx + 

But, if X lies between 0 and 1, then 

£V-'dx, 

and 

Furthermore, if 0 a: ^ 1, then e"*’ ^ 1, so that 

fo^'dxKl. 

Consequently, 

(97-2) dx<l. 
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Similarly, if 1 ^ z-< <», then 
0 < ^ "e"®* 


The integral J^'°xe~^‘dx can be calculated with the aid of 
the fundamental theorem to give 


Hence, 

(97-3) 



xe~*’ dx 


2e 


I 


0 < e-**dx < 


2 e 


It follows from (97-2) and (97-3) that 


The exact value of (97-1) will be obtained with the aid of 
the following ingenious device. Since 7 is not a function of 
the variable of integration, one can write 


(97-4) /=jr%-vdy. 

Multiplying (97-1) by (97-4) gives 

P = fje-^'dxfje-y'dy 

Transforming to polar coordinates by means of 


X = r cos 9 
y = rsm 9, 

and noting that the integration extends over the area of the first 
quadrant of the a:y-plane gives* 



e'^V dr d9 


TT 



Se^ Sec. 46. 
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The same device can be used to evaluate 




Example 2. Evaluate 

<p(a) = x^e~‘“^‘dx 

for a S: «o > 0. Since for any a > 0 there exists a number N 
such that e~““' ^ for a: ^ iV, it follows that ^ ^ for 

X '2: N. Moreover, 


converges, and therefore, the given integral converges uniformly- 
Then, assuming the existence of the integral, 

P v> ^ eo ^ to i^oo 1 

J <p(<x) da j J da dx = J rre”"** dx = 


Hence, 


Example 3. Evaluate 


(pia) = 


and, since 


(p(a) = cos ax dx. 

(p\a) ^ sin ax dx 

be-** sin ax\ ^ xe'^^% 


whose integral is convergent, the differentiation is justified. 
By integration by parts. 


^'(a) = sin ax 

m ( 


«-»’ cos osr d* = —2<9(a). 
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But if 

d<p a<p 

da~ 2* 

then 

d<p a j 

— = -Kda 

<p 2 

or 

log <p = + Cl 

and 

a* 


<P Ce~*. 


In order to determine C, consider 


<p(0) 


-I 


But 

and, therefore, 


“ ’‘'dx = (See Example 1.) 

^(0) = Ceo = C, 


/ N -T 

<p(fiO - -^6 4. 


Example 4. Evaluate 


5W 


(97-5) F{a, U) = dx, where « ^ 0. 

Without loss of generahty /S may be assumed to be positive, 
since a change in the sign of /3 merely changes the si gn of the 
integral. Now 


(97.6) 

and, since for a fixed « > 0, 


|e““* cos (8*1 £ e-“», 

wMch is independent of /3, the differentiation under the sign is 
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dF C” _ 

as Jo ^ “ 


cos Sx dx = e~“ 


S sin fix - a cos S x\ 
a* -h /32 


Cp -f- 


Hence, 


nci, ^) = J dS = tan-i ^ C. 

But Fifit, 0) = 0 and, since (97-5) defines a continuous function 
of/3, 

lim F{ol, jS) = 0 = tan-i - -h C. 
fi-*o a 


Thus 


C = 0. 


Consequently, 


(97-7) F(a, S) = tan”^ -> « > 0. 

a 

It follows from (97-6) that 
(97-8) F(0,S)== 

and if it is demonstrated that (97-6) defines a continuous func¬ 
tion of a (for all a ^ 0 and for a fixed /3), then (97-7) will afford 
a means of calculating the integral (97-8). But, by breaking 
the interval of integration in (97-6) into subintervals of Ifing t hs 

(97-6) can be written as 

« (n+l)ir 

(97-9) F(a,|8) = 2r 

a/nir X 

n-0 “fi 

and it is not difficult to show^ that the numerical value of the 


* If the substitution x ^ 
follows almost immediately. 



is made in the integral, the assertion 
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nth term of the series is less than Furthermore, the series 
is alternating and decreasing, so that the sum of the terms 
beginning with the (n -I- l)st is less than ^ jJ which is inde- 






Fig. 77. 


pendent of «. Hence, the series (97-9) converges uniformly and 
thus defines a continuous function for a S: 0.* Accordingly, 


F(0, 


f* 00 • 

= I 
Jo 


sin 

z 


dx = lim tan 

o-fO-f* 

TT 
2 ’ 


a 


if 


i3>0, 

/S <0, 


= 0, if /3 = 0. 

^ **sin 8 x 

The function defined by I - ^ dx is discontinuous at 

Jo X 

8 = 0 (see Fig. 77). This integral is of importance in the theory 
of Fourier series. 

Example 6. As an example of an integral with a discontinuous 
integrand, consider 


(97-10) 



dx. 


* It should be noted that the continuity of F (oi, 0) (for a fixed fi) does not 
ensure the uniform convergence of the integral (97-6). As a matter of fact, 
the integral is uniformly convergent if « ^ 0, but this has not been demon¬ 
strated above. Instead of constructing the series, one could prove the 
uniform convergence of (97-6) and thus deduce the continuity of FCa, 0). 
This can be done with the aid of the second mean-value theorem for inte¬ 
grals. See, for example, H. S. Garslaw, Fourier Series and Integrals, 2d ed., 
p. 184. 
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1 — X 


= ,1 + X + + • • • + X” + 


j-n+l 

1-x’ 


hence, 


Jo 1^— ^ ~ X X * xdx + 

x"+i 

+ X" log X dx + j- - — log X dx. 


If it is established that 


then 

(97-11) 


J ’l j-n+l 

:j- log X dx = 0, 

0 •*- ~~ ^ 


- 

n«l 

where the last step results from integration by parts. 

The proof that lim i?n = 0 is accomplished without much 

n—> 00 

trouble if one notes that 


J *1 ^ n +1 

where a is a positive number less than unity. Now 

r^iog.dx<a-r^dx, 

Jol-*'’ Jol-a; 

and, since o < 1, the expression* on the right tends to zero 
asn—^ 00 . 


♦ l^Jote Prob. 1 (ji), Sea 95. 
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The reader "will show that is bounded ifO<a^®Sl 

1 — X 

and hence, the second integral in the right-hand member of 
(97-12) likewise tends to zero as n —>■ «. This completes the 
proof of the validity of formula (97-11). 

The function 

has been studied by Riemann and is called the Riemann zeta- 
function* Thus the value of J is — f(2). 


PROBLEMS 

1. Verify the values of the integrals given below: 


(а) 

(б) \ 7^ dx 


(c) 


/:« 

X 

X 


a + 1 

'v/ir 


a > — 1 ; 


(d) I xH'^^dx . , 
ro 4 


(e) «-“* sin a: <fa: = « > 0; 

(/) 


X" 


g—ax ^ g—^x Q 

- dx = log o! > 0, /3 > 0; 

X OL 


is) 

m 

2. Let 




^ 00 

I COS pzdx — g~/JV4a» a > 0: 

Jo 2a 


x; 


a a > 0. 

2a 


n.)- 

Jo 1 + x* 


* See, for example, E. T. Whittaker and G. N- Watson, A Conroe of 
Modem Analysis, Chap. XIII. 
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Differentiate this integral with respect to «, and evaluate the resulting 
integral. Hence, show that 


J ^log(l+x)^ irlog2 
0 '“8 

3. Afisuming that 

is valid for complex values of« s o + W = re^wherea 0, show that 

- 5 ^ 

Set 0 = 0 and 6 = 1, and obtain the Fresnel integrals 

J cos dx ^ I sin x^ dx - ^ 

0 Jo 2V2 

4. Using the formula 


show that 


6. Show that 


l.l£ 


£ ^*- 1 . 

Hint; Integrate by parts, and use I 

Jo 


‘sin/3« - T „ 
—^ da: = -;ifi3 > 0. 


98. Improper Multiple Integrals. Let/(a;, y) be a function of 
two variables x and y which is continuous at every point of a 
two-dimensional region E, bounded by a closed curve C, except 
at the point Q({, ij) where /(a:, y) becomes infinite. The symbol 

(98-1) fj,Kx,y)dS, 


where dS is the element of area of the region B, is called an 
improper double integral. 
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Let an arbitrary infinite sequence of closed curves C\, Cj, 
. . . On, • ‘ • be drawn in E in such a way that each curve 
encloses the point 17 ) and where each curve lies entirely 
within the preceding one. Furthermore, let the greatest linear 
dimension of the region Rn enclosed by C« tend to zero as n 



increases indefinitely (Fig. 78). Denote the closed region which 
is exterior to Cn and interior to C by 

R - Rn, (« = 1 , 2 , ); 

then the function/(a;, y) will be continuous in the regions R — R^ 
and the double integral 


jJ(x, y) d8 


will exist for every value of n. 
If 


lim 

n—* 00 




exists for an arbitrary choice of the regions Rn, then (98-1) 
is said to converge. It follows from the definition of the limit 
that the convergence of (98-1) means that for any « > 0 one can 
find a positive number 5 such that 


(98-2) 


y) ds 


<€, 


for every subregion B' of B which does not contain Q and which 
lies within the circle of radius 5 with center at Q. 
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If /(®, y) contains a parameter a, where ao ^ a ^ ai, then 
the convergent improper integral defines a function of a. More¬ 
over, if the choice of the radius 8 of the circle is independent 
of the choice of a in (ao, ai), then the integral 

V, ci) dS 

will be said to converge uniformly. A uniformly convergent 
double integral defines a continuous function of a, and it may be 
integrated under the integral sign with respect to a. The 
differentiation under the integral sign is permissible if the 
derived integral, namely, 



converges uniformly. 

These considerations can be extended to cover the case of 
improper double integrals containing a finite number of param¬ 
eters. An extension of the definition of an improper integral 
to functions of more than two variables is likewise immediate. 

Thus, if f{Xj y, z) becomes infinite at the point Q(J, rj, f), but 
is continuous at every other point of a three-dimensional region 
R containing Q, then the symbol 

(98-3) y, z) dV, 

where dF is the element of volume, is called an improper triple 
irdegral. If Rn (where n = 1, 2, • • • ) is a sequence of regions 
bounded by the closed surfaces Sn, which are constructed in a 
manner entirely analogous to the construction of the curves C„ 
in the definition of the two-dimensional case, then (98-3) is 
said to be a convergent triple integral provided that 

n-*- 

exists independently of the choice of the regions i2n. 

The following test, giving a suflicient condition for the con¬ 
vergence of an improper triple integral, is used frequently in 
applied mathematics. 

Test for Convergence, hd /(x, y, «) be a continuous function 
(Xt every point P{x, y, z) of the region R with the exception of the 
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point Q(f, V, f), where f{x, y, z) becomes infinite. If there exists a 
positive constant A such that 

(98-4) \r’'Kx,y,e)\ < A, 

where r = -y/(x — |)^ -h (?/ ~ v)^ + (^ — and n < 3, then 
the integral 

(98-5) fjix, y, z) dV 


is convergent. 

The proof of this test follows from the criterion of convergence 
analogous to (98-2). Indeed, if the integral (98-5) is to converge, 
then for an arbitrary e > 0, 

|J^,/(a;, y, z) dV\ < € 

for every three-dimensional subregion 7?' (of 72) not containing 
Q{^, V, f) and lying within the sphere S of radius S whose center 
is at Q. But if the inequality (98-4) is satisfied, then 

(98-6) \( f(x,y,z)dv\< ff^dV. 

Since E' is only a part of the region bounded by the sphere S, 
and since the integrand is positive, it follows that 


(98-7) 



The integral on the right of this inequality can be evaluated 
easily in spherical coordinates, since* 




sin 6 dr dO 


d<p 


3 — n 


But if n < 3, then the magnitude of the right-hand member of 
(98-7) can be made as small as desired by choosing the radius d 
small enough. It follows from (98-7) and (98-6) that 

|J^,/(*, y, z) dv 


* See Sec. 49. 
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can be made as small as desired, and this establishes the conver¬ 
gence of (98-5). 

The reader will show, by using a similar argument, that 
an improper double integral will surely converge if 

l/(^. J/)l <yn’ 

where n < 2, A is a positive constant, and r is the distance 
from P to 

As an illustration of the application of the theory of this 
section, let it be required to calculate the gravitational attraction 
on a unit mass located at a point P{x^ z) due to a distribution 



of mass of density p contained within the volume V (Fig. 79). 
Denote the coordinates of the points of the volume V by (J, rjj f); 
then the density p is a continuous function of V} and f and the 
element of mass dm of the body is 

dm = p dV. 

The attraction at the point P, due to an element of mass dm, 
is given by the inverse square law, namely, 

dm _ p(€y V} f) jxr 

TT - 


where r = + (j, - + (^ - The components 
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of the force of attraction along the coordinate axes are'* 
dm X - k. ^ . y - ‘n _ ^ . g - f . 

hence the force X in the direction of the x-axis is 

(98-8) X = dV, 

with BiTnilflT expressions for the components of force in the direc¬ 
tions of the y- and 2 !-axes. 

The variables of integration in (98-8) are and f, so that 
the element of volume dV can be expressed as df drj df. If the 
point P is outside the volume V, so that r never vanishes, then 
the integral (98-8) is proper. If, however, P is chosen within 
the body, then the denominator of the integrand in (98-8) 
vanishes when i — x, r\ = y, and f = z, but it is not difficult 
to show that the resulting improper triple integral converges. 
Indeed, let the maximum value of p({, v, f) be A; then 

\L . iZL?! < A 

r* r 

and, since the exponent of r is less than 3, the integral (98-8) 
will surely converge. 

The potential $(x, y, z) at the point P due to a distribution 
of mass of density p is defined by the equationf 

(98-9) $(x, y, z) = dV, 

and (98-9) is certainly convergent at all interior points if p 
is a continuous function. 

It is important to note that the maximum density A is inde¬ 
pendent of the location of the point P(x, y, z), so that the integrals 
(98-8) and (98-9) converge uniformly for all values of the param¬ 
eters X, y, and z. Accordingly, the potential ^ and the com¬ 
ponents of force X, Y, and Z are continuous functions of x, y, 
and z throughout all space. 

* See p. 202. 
tSeep. 203 
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iL = ^ y ~ V dr z - I 

dx r dy r ’ Jz - 

it follows from (98-8) that 

‘-If: 

which are precisely the expressions that one obtains by differen¬ 
tiating (98-9), under the integral sign, with respect to the param¬ 
eters X, y, and z. The differentiation under the integral sign 
is clearly justified since (98-8) converges imiformly. Con¬ 
sequently, one can write* 



(98-11) 


d^ 

dx 


TT ^ _ XT 5# 

dy dz 


If the point P is outside the volume V, the integrals (98-10) 
are proper and hence can be differentiated imder the sign. Thus, 


dx 




with similar expressions for ^ and -— 

dy dz 


But 


^ .1 


“ See p. 203. 
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and the expressions for and —— 


are similar. 


Hence. 


dx dy dz 


0 , 


and a reference to (98-11) shows that 


(98-12) 


dx^ ^ dy^ dz^ 


This is the celebrated partial differential equation of Laplace. 

If the point P is interior to the body, the differentiation of 
(98-10) under the integral sign is not legitimate, and the equation 
(98-12) is no longer satisfied unless p == 0. 


PROBLEMS 

1. Prove that the force of attraction at a point P, exterior to a homo- 

M 

geneous sphere, is F where B is the distance from the center of 

the sphere to the point P and M is the mass of the sphere. 

2. If the force of attraction exerted by an element of mass dm on a 

point is ^^7 where r is the distance from the element of mass to the 

point, find the attraction of (a) a homogeneous right-circular cone upon 
a point at the vertex; (h) a homogeneous right-circular cylinder upon a 
point on its axis. 

Am, (a) 2fjrkf>hil — cos a), where h is the altitude and 2o: is the angle 
at the vertex; 

(6) 2^kp[h + ^2 _ \/(P + h)^ + a* ], where h is the 

altitude and a is the radius of the cylinder, and R is the dis¬ 
tance from the point to one base of the cylinder. 

3. Find the force of attraction on a unit mass located at a point within 
the cavity of a homogeneous spherical shell. 

4. Find the potential due to a homogeneous spherical shell at all 
points exterior to the shell, and within the cavity. 

5. Find the potential at the points on the axis of a homogeneous cylin¬ 
drical shell. 

99. Gamma Functions. An interesting function, which pro¬ 
vides a generalization of the factorial, is defined by the improper 
Integral 
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(99-1) r(Q!) = ^ a:« h *&, where a > 0, 

and is called the Gamma function. 

If a is a positive number less than unity, the integrand of 
(99-1) becomes infinite at the lower limit a; = 0, so that it becomes 
necessary to investigate the behavior of the integral at both 
limits. Accordingly, (99-1) will be written as the sum of two 
integrals, namely, 

(99-2) rCci) = dx dx, 

the second of which has a continuous integrand for all values of 
a: ^ 1. Moreover, this second integral converges if a > 0 
since* 


lim x^(e~‘^x“-^) = lim x<*+^e-^ = 0. 

X —► 60 60 

If a ^ 1, the first integral is proper, since its integrand is 
continuous. It remains to investigate the behavior of the 
integral 

(99-3) 

when 0 < « < 1. Now 

lim x’’(x^~^e~^) = 0, if A; -t- a — 1 > 0, 

aad this condition is surely satisfied ifl—a<fc<l. It 
follows from the corollary to the theorem of Sec. 95 that (99-3) 
is a convergent integral. 

It is also clear that (99-1) diverges if a 0, so that (99-1) 
defines a function for positive values of a only. However, 
it is possible to define the function r(a) for negative values of a 
with the aid of the recursion formula which will be developed 
next. 

If a > 0, then it follows from (99-1) that 
(99-4) r(a + 1) == 

* See corollary to Tlieoretii 1, Sec. 93. 
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Integrating the right-hand member of (99-4) by parts gives 
dx = ” -f dx 

= dx 


Thus, 

(99-5) 


= «r(a). 

r(a -f 1) = «r(c£). 


But 

so that when a 


r(l) = ^“e-* dx = 1, 

1, the formula (99-5) becomes 

r( 2 ) = 1 • r(l) = 1. 


Setting a = 2, 3, • • • , n gives 

r(3) = 2 r( 2 ) = 1 - 2 , 
r(4) = 3r(3) = 1 • 2 • 3, 


r(n) = (n - l)r(n - 1) = (n - 1)!, 
r(n 4 - 1 ) = nr(n) = n\. 

Hence, the formula (99-5) enables one to compute the values of 
r(a) for all positive integral values of the argument a. 

If by some means (for example, by using infinite series) the 
values of r(a) are obtained for all values of a between 1 and 2, 
then, with the aid of the recursion formula (99-5), the values of 
r(a) are readfly obtained when «lies between 2 and 3. Knowing 
these values, it is easy to obtain r(a!) where 3 < a < 4, etc. 
The values of r(a) for a lying between 1 and 2 have been com¬ 
puted* to a high degree of accuracy, so that it is possible to find 
the value of r(o!) for all « > 0. 

It remains to define r(a) for negative values of a. The 
recursion formula (99-5) can be written as 

( 99 - 6 ) r(a) = E<£L±i). 


The formula (99-6) becomes meaningless when a is set equal to 
zero, since 

limr(a) = +00 and limr(a) « — ot/. 

a—*0+ «—►O — 

♦ Small table is found in Peirce's ''Table of Integrals," p. 140, 
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It follows from (99-6) that the function r(-«) is discontinuous 
when a is a positive integer. 

If any number -1 < a < 0 is substituted in the left-hand 
side of (99-6), the right-hand side gives the value of r(—a), 
since the values of « -f- 1 lie between 0 and 1, and 1 ( 0 ) is known 
for these values of a. Thus, 


r 



- EM 
-M’ 


r(-o.9) 


r(o.i) 

-0.9 


, etc. 


In this manner the values of r(o!) for -1 < a < 0 can be com¬ 


puted. Knowing these values 
(99-6), the values of r(a) for 
— 2 < a < — 1 can be obtained, 
etc. The adjoining figure rep¬ 
resents the graph of r(o!) (Fig. 
80). 

It was observed that 
r(a -I- 1) = a! 

when a is a positive integer. 
This formula may serve as the 
definition of factorials of frac¬ 
tional numbers. Thus, 

T(H) = HI 
T(H) “ (-K)!, 
r(i) = 0 ! *= 1. . 


and using the recursion formula 



This section will be concluded with an ingenious method* of 
evaluating H !• Now 


= r(^) = e~’‘x^dx. 

If the variable in this integral be changed by the transformation 
X = y*, the integral becomes 

(99-7) H^ = 

Since the definite integral is independent of the variable of 
integration and is a function of the limits, 


* Se« slao Sec. 97. 
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(99-8) 3^! = 

Multiplying (99-7) by (99-8) gives 

which can be written as a double integral 

(99-9) (H!)® = 4^ "X dy dz. 

In order to evaluate (99-9), transform it into polar coordinates 
by setting z = r cos d and y = r sin d. The element of area 
dy dz becomes r dr dd, and (99-9) becomes 


But 


and 


(MO* = ^ ® d^- 

f: 


sin^ 6 cos^ 0 dB 


X’°e-'Ydr 1. 


The latter integral is evaluated by integration by parts. There¬ 
fore 


i2 


T 

I 


or 


2 2 ■ 


It can be shown with the aid of the recursion formula that 


(-M)! = V^. 


PROBLEMS 

1. Compute the values of r(«) for every integer and half integer from 

0 to 5 by using the relations r(l) = 1 and r(>^) = Plot the curve 

y = r(a) with the aid of these values. 

2. The beta-function B(fft, n) is defined by the integral 


B(»n, ») 


X‘ 


*(1 ■— dx. 
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If X is replaced by in r(n) = dx, there results 

r(w) = 2^ 

Using this integral, form 

r(w)r(n) = 4j^ '^y2m-i^-v* ^jiy^ 

Express this product as a double integral, transform to polar coordinates, 
and show that 

B(™, „) - B(,, m) - 

3. Show, by a suitable change of variable, that (99-1) reduces to 

4. Show that 

d"F(a) r* . n ^ ^ 

—- = I x«-ie“*(log a)»* dx, 

aa« Jo 

and justify the differentiation of (99-1) under the integral sign. 
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100 Criterion of Approximation. It is already known* that a 
suitably restricted function fix) can be represented in a senes 
of ascending powers of The restrictions unused upon (x) 
are quite severe inasmuch as it is assumed that the function 
not only possesses derivatives of all orders, but ^so that the 
remainder in the expansion converges to zero uniformly, t It 
is obvious that a function that is capable of a power-senes 
representation can be approximated arbitrarily closely in a given 
interval by a polynomial of sufficiently high degree. The 
criterion of the closeness of approximation in this case consists 
of the requirement that the numerical value of the deviation of 
the values of the function from those of the polynomial (that 

n 


IS, 


the remainder iJn(x) ^f{^) ^ niade less 


than some specified amount for all values of x in the given 
interval. 

The question naturally arises whether it is possible to represent 
a given function/(x) by a trigonometric polynomial of the formj 


(100-1) Sn{x) - J cos kx + h sin kx), 

*-i 

where a* and bk are real constants so selected as to satisfy some 
criterion of the goodness of approximation. 

It should be observed that since every term in the right-hand 
member of (100-1) is a periodic function of period 2ir, Sn{x) 


* See Chap. IX. 
t See Sec. 82. 

t The reasott for writing the constant term as ^ will appear in the next 
section. 
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is also periodic.* Consequently, only periodic functions f(x) 
of period can be approximated by a polynomial of the form 
(100-1). Or, what amounts to the same thing, one can restrict 
the problem of approximating a nonperiodic function f{x) 
to some interval of width 27r and define the function f(x) outside 
this interval so that it is periodic. It will be assumed from this 
point on that the problem of approximating f(x) by a trig¬ 
onometric polynomial is confined to the interval (—t, t) and 
that outside this interval the function /(x) is defined by the 
equation/(x + 2ir) = /(x). Of course, any interval (a, a + 2t) 
will do equally well. 



In formulating the problem of approximating /(x) by a trig¬ 
onometric polynomial >S«(x), one could demand that the coeffi¬ 
cients ajb and hk be so chosen as to satisfy the requirement that 
the difference 5n(x), between the values of the function /(x) 
and the polynomial >Sn(x), does not exceed a prescribed amount 
for all values of x in the interval (—x, x). However, such a 
criterion would regard the dotted curve shown in Fig. 81 as 
constituting a better representation of the fimction /(x), shown 
by the solid line, than the wavy dotted line approximating the 
same function/(x) in Fig. 82. For it is clear that the maximum 
deviation of the approximating function shown in Fig. 81 is 
less than the corresponding maximum deviation shown in Fig. 82. 

It appears more reasonable to set up as a criterion for the 
goodness of approximation the magnitude of the integral of the 
absolute value of finC^c), namely, 

dx, 

* A function is said to be periodic of period a if f{x) — /(» + a). 
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since this integral represents the shaded area between the curves 
Sn(x) and fix). The closer the approximating curve lies to 
fix), the smaller the magnitude of the integral will be. However, 
a study of integrals containing absolute values of functions in 
the integrand is quite difficult, and it is customary to consider 
the integral of the square of S„ix) instead of the integral of its 
absolute value. Accordingly, it will be agreed that the “best” 
approximation for the function fix) by means of a trigonometric 
polynomial Snix) is that polynomial in which the coefficients 
a* and 6* are so selected as to make the magnitude of the integral 


( 100 - 2 ) 7 „ = 

n 

= j ^fix) - ^ ~ 


A:-l 


a minimum. 

Therefore, the problem of determining the coefficients in 
(100-1) is reduced to that of minimizing the function In of 
2n + 1 variables a* and bk. The following section is concerned 
with this problem of minimizing the integral (100-2). 

101. Fourier Coefficients. Let f(x) be an integrable* (and 
hence bounded) function defined in the interval — tt x 
and let JSn(x) be the trigonometric polynomial 


^ 

ifc-i 

where the coefficients ah and 6* are to be selected so as to render 
the integral 

n 

(101-1) /„ = J* |^/(a;) — ^ (®* cos kx -f- hk sin kz) 1 dx 

a minimum. 

*See p. 110. 
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Calculating the partial derivatives gives 

I ^ r*y s do “I 

dao “ J-ttL*' 2' 2^ + ^*sin kx) dxy 

Jfc«l -* 

jdOfc ** cos kx 4- hk sin kx) 1 cos kx dx^ 

aoi-2K t" J 

(A; =s 1, 2, • • • , n), 

1 *-l 

(A; *« 1, 2, , n). 

But it is known that 

cos fca; cos mx dx = 0 , if k ^ m; 

= IT, if h = m 9 ^ 0 ; 

(101-3) sin kx cos mx dx = 0; 

^ sin kx sin mx dx — 0 , if k 9 ^ tn-, 

— V, if k = m 9 ^ Q] 

so that carrying out the integrations indicated in (101-2) gives 


! dl^ 
dao 

do* 


==-r 

0 J-, 


Six) dx -f jTOo; 


- _2 r 

dh,- 2j_ 


1 fix) cos kx dx + %rak, 

ml -“*■ 


< 

1 

II 

• • , n) 

J fix) sin kx dx + 2irbk, 


(fc = 1, 2, 

• • , n) 


The necessary condition for a minimum of 7„ (see Sec. 89) 
requires that these derivatives vanish, and this leads to the 
following values for the coefficients: 


(101-6) 




- I fix) cos kx dx, (Ji: = 0, 1, 2, • • • , n); 
wj 

1 

- I f(x) sin kx dx, (fc = 1, 2, • • * , n). 

Tj ~,r 
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It follows immediately from (101-4) that the coefficients a, 
and h so obtained make (101-1) a minimum, since 


dal dhl 
dal 


= 2t, (fc = 1, 2, • • • , n), 


== T, 


whereas all the mixed derivatives of the second order vanish. 
The constants a, and h defined by the formulas (101-5) are 

QsXLed the Founer coefficients of the furichon fix). 

Some insight into the character of the approximation of a 
function /(x) by the trigonometric polynomial can be gained 
by expanding the integrand in (101-1) and integrating those 
terms which are free of f{x). The result is 

I.- f{x) dx 

^ f{^) cos kx dx + f(x) sin kx drcj 


rt 

-f- ^ -f ir ^, (al -t- bl), 

k~l 


which, upon substitution from (101-5), gives the important 
formula for the magnitude of the integral of the square of the 
deviation. 


(101-6) I, 


” I 

= r [/(a:)]*dx - 41 + 1 

•a-’" *- t_i 


71 

Since I» is never negative and the sum ^ (al + hi) is an 

fc-i 

increasing function of it follows that Jn is a monotone-decreas¬ 
ing function of n. Consequently, the approximation of f(x) 
by the trigonometric polynomial 

n 

S»(x) = ^ -h 2 (at cos fcx -t- hk sin kx), 
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Where the coefficients are determined by (101-5), improves with 
the increase in the number of terms of the polynomial. 
^Moreover, it foUows directly from (101-6) that the series 
of the squares of the Fourier coefiScients, 

(101-7) f + 2w + w. 

Jb-1 

converges whenever f(x) is an integrable function. For, since 
In S: 0, it is evident that 

n 

( 101 - 8 ) + ® 

Jc-1 

Now the left-hand member of the inequality (101-8) is precisely 
the nth partial sum of the series (101-7), and since it is bounded, 
the convergence of the series (101-7) fcUows directly from 
Theorem 1, Sec. 62. Furthermore, the terms of any convergent 
series form a null sequence, so that the Fourier coefficients of 
any integrable function/(«) tend to zero with increasing n. 

It was shown* by Liapunoff, in 1896, that the limit of J„ 
as n increases indefinitely is zero, so that the following remarkable 
formula is true whenever f(x) is an integrable function. 

00 

f +2 (“2 + ® • 

However, the fact that the integral of the square of the devia¬ 
tion tends to zero when the number of terms in the trigonometric 
polynomial is increased indefinitely does not establish the 
convergence of the Fourier series 

«0 

(101-9) — -f cos Axr -f- 6* sin kx). 

k-l 

In fact, if f(x) is merely an integrable function, the Fourier 
series noay fail to converge either at some points of the interval 

• See Whittakiie, E. T., and Watson, G. N., Modem Analysis, p. 170. 
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or even in the entire interval {—r, t). Even if the Fourier 
series (101-9) does converge, its sum is not necessarily/(a:). 

In order to establish the convergence of (101-9), it is necessary 
to impose some additional restrictions on the function f{x). 
There are several sets of sufficient conditions which will ensure 
convergence of the Fourier series. One of the most celebrated 
of these is due to Dirichlet, and it is set forth in the follow in g 
section. The discussion of the next section makes use of the 
following theorem. 

Theorem. If f(x) is an integrcible function in the interval 
a < X then the integrals J^f(^) cos nx dx and J^f(x) sin nz dx 

tend to zero as n increases. 

If the interval (a, /3) is of length %r, then it follows from (101-5) 
that* 



cos na: dx 


— J^^f(x) cos nx dx = a„T, 


and it was noted above that the Fourier coefficients of an inte- 
grable function form a null sequence. If the interval (a, 
is of length less than 2ir, define the function <p{x) in the following 
way. Let <p(x) =fix) in the interval (a, j9), and let <p(x) = 0 
at all other points of the interval of length 2 t. Then 



cos nx dx = cos nx dx = o„ir, 


and it follows as before that a„ — » 0 as n oo . If (a, /3) is an 
interval of length greater than 2 t, then it can be broken up into 
a finite number of intervals of lengths less than or equal to %r. 
Then the integral 

cos nx dx 

can be expressed as the sum of a finite number of integrals of the 
type considered above, each of which tends to zero as n <», 
The proof for the integral 

sin nx dx 

is entirely similar. 


It will be recalled that the function f(x) is assumed to be periodic of 
period 2ir. 
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102. Conditions of Dmchlet. 

Theorem. Let f(x) be a function defined arbitrarily in the 
interval -—t ^ x ^ t, and outside this interval defined by the 
equation fix + 27r) = f{x). If f(x) has a finite number of points 
of ordinary discontinuity and a finite number of maxima and 
minima in the interval ’—ir ^ x ^ tt, then it can be represented by 
the series 


ao 

2 


+ (uk cos kx + bk sin kx), 


X;-l 


with 

1 T' 

Ok -I fit) cos kt-dt, 
rrj 

bk - I fit) sin kt dt, (A; = 0, 1, 2, • • • ), 

TJ 


which converges at every point x = xo of the interval to the value* 


/(a:o4-) +/(a^o—) 
2 


The restrictions imposed upon the function fix) in this theorem 
are known as the Dirichlet conditions. 

In order to establish the theorem it is necessary to show that 
for any x in the interval 


lim Snix) 

n—♦ « 


fix + ) +fix-) 
2 ’ 


where 

(102-1) Snix) = Y + 2 Aa: -I- 6* sin kx). 


* li fix) is continuous at the point a; = xo, then/(a?o+) =/(a:o—) =/0cb), 
so that at all points of continuity the series converges to f(x). At the 
points of ordinary discontinuity it converges to the arithmetic mean of the 
values of the right- and left-hand limits. 
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Substituting the values of ak and bk in (102-1) gives 
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Jc'^1 


M cos kx + sin kt sin kx) dt 


The expression appearing in the bracket can be summed with 
the aid of the trigonometric identity* 


cosku = 


k-l 


. (2n l)u 

sm- 

2 Sin ^ 


so that <S„(a:) can be written as 


w*) = Ij 


sin (2n + 1)~ a"" 

\ . t-x 
, 2 sm — 


Setting t-x = 2u, gives 

r-~g 

1 r ^ . « \Sin (2n + 1)^ 

(102-2) S.(i) - ij 1(* + 2-)-551;- 

2 

Thus the study of the limit of Sn{^) as n —>■ <» is reduced to 
the study of the behavior of an integral of the form 


“ t*roof: 


sin 


^(i+cos« 


+ cos 2u + • ■ • + cos nu 




1 . 

> — sm 


Jfc *! 
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(102-3) 

Ja sin w ^ 

when m is allowed to increase indefinitely. This integral is 
known as the integral of DiricUet^ and a study of it reveals that 
the limiting value of (102-2) as n—^ oo is precisely equal to 
y^[f{x+) —)]. Unfortunately, a detaUed discussion of 

the integral (102-3) is very involved,* and for this reason the 
convergence of (102-2) will be established under the hypothesis 
that/(a:;) is a differentiable, and hence, continuous, function. 

Consider first the function F(a;) = 1. All the Fourier coeffi¬ 
cients, with the exception of ao, of such a function vanish, so 
that (102-2) gives the identity 

if 

vj-r-x smix 


which is valid for all values of n. If both sides of this identity 
are multiplied by/(*), there results 

V — X 

(102-4) f(x) = i f 
Subtracting (102-4) from (102-2) gives 

y—.x 

(102-6) -S,(*)-/(x)=if' [/(a;-l-2u)-/(*)]52i^^d« 

~y~x sm u 


1 r " \ f(x + 2u) - m 



+ Du du. 


Now the expression appearing in the bracket of the last integral 
is a continuous function of w, except, possibly, when w = 0. 
But 


llTYI 


2u 
sin u 




* Knopp, K.. Theory and Application of Infinite Series, p. 356. 
Cabslaw, H. S., Fourier's Series and Integrals, p 207. 
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since 

lim = 1. 

„-o sm u 

Hence, if the value of the function 

/(a; + 2u)-/(x) . 2u 
^ w 2 m sin u 

is defined at tt = 0 by the equation 

F(0) s 2fix), 

then Fiu) is surely bounded. But the theorem of the preceding 
section states that for any integrable function <p{u) 

lim r%(u) sin nu du = 0, 

n—►« 

so that the integral in (102-5) approaches zero as n—> oo. 
Accordingly, 

lim Sn(x) = f(x). 

n—^ 00 

The foregoing proof can be extended to include the case of a 
function with a finite number of ordinary discontinuities if 
the function possesses a derivative at every point where it is 
continuous. 

103. Orthogonal Functions. A set of continuous functions 
(103-1) ui{x), ui(x), ■ ■ • , u„{x), 

which do not vanish identically in the interval a a; 6, is 
said to be orthogonal with respect to the interval (o, 6) if the 
functions Mf(a:) satisfy the relations 

(103-2) J^Ui{x)u,(x) dx = 0, if i 9 ^ j. 

For i = j, (103-2) becomes 

J^V(x)]* dx s c?, 

where c? certainly is not zero. 

If each of the orthogonal functions Ui(x) be divided by Ci 
there will be obtained a system of normal orthogonal functions, 
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vi{x) 


Cl 


V,(x) = . . . , = <E), . 

^2 Cn 


which are characterized by the property that 


(103-3) Vi(x)vj(x) dx — 0, if % 

= 1, if i = j. 

Consider a set of normal orthogonal functions Vi(x)j and 
assume that an arbitrary function f{x) can be expanded in a 
series 


(103-4) f(x) — aiVi{x) + 0 ' 2 V 2 (x) + • • • anVnix) + • • . 

00 

which can be integrated term by term. Multiplying both sides 
of (103-4) by Vj{x), and integrating term by term between the 
limits a and 6, 


jy{x)vj{x) dx = aij‘\i{x)v,ix) dx, 

which, by virtue of (103-3), gives the formula 

(103-5) Oi = J^f{x)vi{x) dx, (i = 1, 2, 3, • • • )• 

The numbers Oj are known as the Fourier coefficients of the 
function/(a;) associated with the system of normal and orthogonal 
functions 


vi{x), Vi(x), • • • , o„(x). 
The set of functions 


1 cos x sin X cos 2x sin 2a: 


cos nx ^ sin nx 
"v/ir -y /T 


is obviously a normal orthogonal set in the interval (—ir, ir). 

Instead of approaching the subject of the expansion of arbitrary 
functions in a trigonometric series with the aid of the criterion 
of Sec. 100, one could begin by assuming that it is possible to 
expand the function/(a:) in a series 
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(103-6) fix) = ^+'^(ak cos kz -f bk sin kx), 

jfc-1 

which can be integrated term by term in the interval (—tt, t). 
Multiplying both sides of (103-6) by cos mx, and integrating 
term by term with the aid of the formulas (101-3), gives 

Oi = - I fix) cos kx dx, ik = 0, 1, 2, • ■ • ). 

Similarly, multiplying (103-6) by sin mx, and integrating the 
resulting series term-wise, furnishes 

1 

bh = -\ fix) sin kx dx, (Jb = 1, 2, 3, • ■ • ). 

Thus, the hypothesis that the function fix) can be expanded in 
a trigonometric series (103-6) that can be integrated term by 
term leads to the same values of the coeflacients as those obtained 
earlier by an entirely different method. 

It is seen from the foregoing that the discussion of Secs. 100 
and 101 constitutes a very special case of the problem of repre¬ 
senting an arbitrary function fix) by a series of orthogonal 
functions. 

104. Expansion of Functions in Fourier Series. This section 
contains some illustrative examples of expansion of functions, 
satisfying the Dirichlet conditions in the interval (—x, ir), in the 
series 

00 

(104-1) Y (®» cos na: -f- 6„ sin nx), 

n-l 

where the coefficients On and 6„ are given by the formulas 
(104-2) a„ i I fix) cos nx dx, 

irj 

and 

(104-3) i I /(x) sin nx dx. 
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Illustrative Exawple 1. £xp9>D.d /(ai) == x ii^ Fourier series in 
the interval ir ^ x ^ t. Calculating the coefficients a„ and 
hn gives 


and 


€ 


X COS nx dx = 0, 


X sin nx dx = — cos nr. 

n 


Hence, 

X = 2[(—3^ cos r) sin x + (—K cos 2r) sin 2x 

-|- cos 3r) sin 3a; + 


or 


. sin 2x , sin 3a; \ 

2|^sm a; - - + —^ j. 

In this particular case only the sine terms remain. It may be 
noted that whenever the function/(a;) is an odd function, that is, 
when/(-a;) = -f(x), then = 0, forn = 0, 1, 2, • • • , since, 
for such a function, 


cos nx dx = ^ 

Similarly, if/(a;) is an even function, that is, when/(—a;) = /(a;), 
then bn = 0, forn = 1, 2, 3, • • • , since 

J^^f{x) sin nx dx = sin nx da;, 

so that the function would be represented by a series of cosine 
terms. 

If in the foregoing illustration the first four terms be plotted by 
composition of 

2/ = 2 sin a;, ^ = —sin 2a;, y — % sin 3a;, y = —3^ sin 4a;, 


the curve 


y == 2 sin a; — sin 2a; + % sin 3a; — 3^ sin 4a; 

is obtained. It is represented on Fig. 83. As the number of 
terms is increased, the approximating curves approach y = a; as a 
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liimt for all values of x, —ir < x < v, but not for x — ±it. 
Since the series has period 2 t, it represents the discontinuous 



■>-x 


Fig. 83. 


function, shown in Fig. 84 by a series of parallel lines. It should 
be noted that each term of the series is continuous and the func¬ 



tion from which the series was derived is continuous, but the 
function represented by the series has finite discontinuities at 
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a; — ± (2k + l)7r. At such points the series converges to zero 
which is one-half the value of the sum of the right- and left-hand 
limits. 

Illustrative Example 2. Develop f(x) in Fourier series in the 
interval (—-tt, t), if 


Now 


f(^) = 0, for 

= TT, for 


—IT < ir < 0, 
0 < X < TT. 


ao 

<Xn 

6 


1 h 

= " I T COS nx dx = Oy 
rjo ' 

1 C . 

n = - I tr sin nx dx = -(1 — cos nic). 
IT Jo ^ 


The series is then 


ir . Bin X . sin 3x , sin 5a; , \ 

- + 2[-j-+- +-^+ J 

The graph of f(x) from —ir to x consists of the a:-axis from 
-X to 0, and the line AB from 0 to x (see Fig. 85). There is a 



finite discontinuity for a: = 0. For a: = 0 the series reduces 
to which is equal to half the sum of lim/(0 — «) and lim/(0 + e). 

A e—♦ft •-♦O 
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It may be observed from the series that every approximation 
curve wiU pass through the point (o, |). The figure shows the 
first, second, third, and fourth approximation curves whose 
equations are 

_ T , , sin 3x\ 

y = %’ = I + 2 sin a;, y = ^ + 2^sin a; + -j- j, 

^ J . . sin3x , sinSx^ 

= | + 2^smx + — +—j’ 


as well as the graph of /(x). 

^ the series reduces to and again every approxi¬ 

mation curve gives this same value for the ordinate at ±7r. 
This value is one half the sum of/(-ir-f) and/(7r-). 

illustrative Example 3. Let fix) be defined by the relations 

fix) = -IT, if — T < X < 0, 

= X, if 0 < X < t; 


then the Fourier coefficients for/(x) are given by 

= i/>) * - ^ + X'* *] - 


da 


On 


TT 


= -(* /(x) cos rax (ix = J* — IT cos rax dx-f J* xcosTixdxj 


-;X: 


f{z) Bmnxdx ^ - 


- , cos nTT 

Q ^ - 

cos nw — 


^7^ — 1 


-w Bin nx dx-h I x sin nxdx 


i: 

ifir IT IT 1 

. J-COS mr-cos mr 

T[_n n ^ J 

! i(l — 2 cos «*). 
n 


X sin nxdx j 
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r/ \ 2 2 cos3x 

Z o 

When = 0, the series reduces to 


2 cos 5x 

T 5^ 

sin 4a; ^ 3 sin 5x 


-I _ 2/1 4. 1 . 1 4. ^ 

4 ir\V + 3® 5* / 



which must coincide with (see Mg. 86) 


/( 0 +)+/( 0 -) 

2 


T 

’2 


Thus, 


Hence, 


—IL — 2/1 ^ 1 ^ 1 ^ = —Z. 

4 r\V ^ 3 * ^ 6 * ^ / 2 


1 1 + 1 ^ 
I* ^ 3* 6* ^ 


8’ 


Also for X = ±T, the series pves 

+ 2/1 

4 ^tU* 


+ ^+i + 

T 3 * T g, T 


)« 0 , 


•iOC 
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since 

/(-7r+) +/(^-) 

2 

This example suggests the use of Fourier series in evaluating 
sums of series of constants. 

PROBLEMS 

1. Show that 


cosnx 

- 3 +4^(-!)•—. 


(~T S a; ^ ir). 


2. K 


then 



for < a? < 0, 

for 0 < a; < tt; 


2x^ cos (2n - l)a; ^ ^ (-1)’* sin nx 
’ 4 TT^ (2n-l)2 n 


n-l 


3. If 


then 


f{x) == 0, for 

= sin Xj for 


-T ^ X ^ 0^ 

0 X ^ ir; 



n-l 


COS 2nz 
4n^ — 1 


1 . 

2 sin a?. 


4, If/(x) = e* in the interval (0, 2t), then 


00 to 

= ^Lnir 1 _L ’V’ cos ^ _ ■>^n sin nx 
T [ 2'^^1 + n * ^1 + n * 

n-l 

6. Deduce from Prob. 1 that 
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cos ax — 




2 a sin ira 
7r(a* — n*) 


cos nx, 


if —TT S X Stt. 

7. Deduce from Prob. 6 that 


cot TTa 


oe 

X \a 

n«l 


2a 



8, Deduce from the expansion of/(^?) == a; + a?* in Fourier series in the 
interval (—tt, it) that 



n-l 


9. Expand x sin x and x cos x in Fourier series in the interval (0, 2ir). 

10. Find the Fourier series expansion for/(x), if 

/(») = |) for —IT < X < |> 

= 0, for ~ < a; < TT. 

106. Sine and Cosine Series. The Fourier expansion for /(x) 
in (—IT, tt) has the form (104-1), in which the coefficients o„ and b„ 
are given by (104-2) and (104-3). As previously observed 
(Sec. 104), if f(x) is an even fimction, (104-1) reduces to a series 
containing only cosine terms; and if f{x) is an odd function, 
(104-1) reduces to a series contatuing only sine terms. Now 
suppose that it is desired that fix) be expanded in a Fourier 
series which will be used for the interval 0 to ir only. In that 
case it is frequently convenient to obtain the expansion in terms 
of sines alone or in terms of cosines alone. For this purpose 


define 





Fix) ^fix) 

for 

0 < X < IT, 

and 





Fix) ^fi-x) 

for 

—ir < X < 0, 


80 that Fix) is an even function identical with/(x) in 0 < x < t. 
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For an even function: 


= - r F{x) sin nx dx 

= - j Fix) sin nx (fa + Fix) sin nx <ix J 
= if - rV(-x) sin (-nx)(-cfa) + I F(x) sin nx dx 

j: Fix) sin nx (fa J = 

and 

On = -l Fix) cos nx dx 
vj-r 

j: 2 ^( 0 ;) cos nx dxj 

X’ Fix) cos nx dx | 

= - I Fix) cos nx (fa. 
vjo 

Hence, in the expansion of Fix) in the interval - v < x < x only 
the cosine terms appear. Moreover, Fix) is identical with fix) 
for 0 < X < X. Therefore,* 


(106-1) fix) = ^ -4- oi cos X -I- o* cos 2x -f • -f o» cos nx 

JU 

+ ■ ■ 

in the interval (0, x), where 

2 f' 

(105-2) o» = - I fix) cos nx dx. 


Similarly, if F{x) be defined so that 


Fix) =/(x) 

for 

0 < X < IT, 

and 



in 

1 

for 

—r < X < 0, 

* If f(x) has a finite discontinuity at the point » xo, then the left-hand 
member of (105-1) is defined to be Jil/(xb+) +/(«o— )]. 
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then the o* all vanish and 

(105-3) fix) = bi sin z -f bt sin 2x -f • 

where 


399 


-f sin na; 
+ 


(106-4) - I fix) sin nx dx. 

IT Jo 

Thus fix) can be represented in the interval 0 < a: < t by either 
(105-1) or (105-3). Frequently one series is more desirable 
than the other. 



Example. As has been determined already (see Example 1, 
Sec. 104), the expansion for/(a:) = a; in a sine series is 


X — 


2^si 


2( sinx 


sin 2x . sin 3x 
2 3 



This series represents fix) = x in the interval (— t, t ). If one is 
interested in the values of the function in the interval (0, v), the 
same function can be expanded in a series of cosines. 

In fact, in the interval (0, v), 


TC 41 cos X , vavro 

SS ^ — —I *1 02 "• • 


z , cos 3x , cos 5x 


2 t\ 1 


3“ 


5* 


> 


Since 


and 


ao 


-f 

xjo 


X dx 


On 




cos nx dx = 1)" ~ y* 
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The sine series represents the odd function shown in Fig. 87 
flTiH the cosine series the even function in Fig. 88. The two 
graphs are identical in the interval (0, ir). 

PROBLEMS 

1. Show that if c is a constant, then, in 0 < « < 

4/ . . sinSa; , sin 6a; , V 

c = <^(^sina; + ^ + —+ )■ 

2. Give sine and cosine developments of j/ = a: sin x in the interval 

(0,t). 

3. Show that, in (0, tt), 

— ^ sin 4a; + 


4. Prove that ii fix) is any function of x, it can be expressed as the 
sum of an even function of x and an odd function of x, 

6 . Show that if fix) = a; for 0 < a; < and/(a;) = tt - x for - < x <' 7 r, 

then 

TT 2/cos2x , cos 6x , c os lOx 
fix) = 4 - 12 “ + + 6 * 

6. Show that 

“ »<*<- 

n-l 

7. Find the expansion in the series of sines, if 



fix) =^x, 0 a: ^ 

= - ®), I ^ ® 


8. Expand/(®) = e* in the series of cosines in the interval (0, xr). 
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106« Extonsion. of Interval of ^Expansion. The methods devel¬ 
oped up to this point restrict the interval in which f(x) can be 
expanded in a Fourier series to (—tt, tt). In many problems 
it is desirable to develop f{x) in a Fourier series which will be 
valid over a wider interval. In order to obtain an expansion 
which will hold for the interval (~Z, Z), change the variable by 

replacing x by Then fix) = f(^ can be developed in a 
Fourier series in z, 

00 00 

(106-1) y 2^” 

n-1 n»l 

in which 



The expression (106-1) will be valid for —t < 2 < ir, but 

*irx 

2 = — so that (106-1) becomes 

«e CO 

(106-2) fix) = ^ + 2“" ^ 

n—l n—1 

Also, 

1 f’ Jiz\ , 1 r' //■ \ j 

a, -J /i ~mdz = ^fix) cos -j- ax 

and 

K = f(^ sin na ete = jJ* ^/(«) sin ^ dx. 

Example. Develop fix) in Fourier series in the interval 
(- 2 , 2 ), if/(*) = Ofor -2 < a: < 0, and/(a:) = 1 forO < a: < 2. 



ADVANCED CALCULUS 


402 


§ioe 


Here 

Co = 2^ " X ^ ~ 

Therefore, 

1 2 / . ira; . 1 . 3ira; , 1 . \ 

PROBLEMS 

1. The expansion of/(*) is desired for 0 < x < i- If F{x) s /(a) for 
0 <x <l and F(x) s —f{—x) tor —I <x <0 (that is, F(x) is defined 
as an odd function), show that the expansion of F(x) and /(x) for 
0 < X < i is 

2 , . Twrx 

5.sm-p, 

n — l 

where 



If <pix) s f(x) for 0 <x <1, and <p(x) s f{—x) for —Z < x < 0 (that 
is, ^(x) is defined as an even function), show that the expansion of 
<p(x) and f(x) for 0 < a? < Z is 


where 


Oo , nirx 

2 + T' 


n*-! 


f£‘ 


.f . nicx , 
/(x) cos -y- OX. 


2. Using the results of the preceding problem obtain the sine and 
cosine expansions of the following functions: 


(а) /(x) « 1 in the interval (0, 2); 

(б) /(x) *= X in the interval (0, 1); 
(c) f(x) ** X* in the interval (0, 3). 
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3. Expand /(ic) = cos to in the interval (—1,1), 

4. Expand 


f(.x) = H-x, if 0 <x <J4, 

= if H <x <1, 

in the series of sines. 

6. Find the expansion in the series of cosines, if 

/(a:) = 0, if 0 < a: < 1, 

= 1, if 1 < a: < 2. 

6, Expand fix) = |a:| in the series of cosines in the interval (-1, 1). 

7. Show that the series 



2nTO 

~T 


n*! 

represents — x when 0 < x < 1. 

8. Find the expansion in the series of cosines, if 

fix) = 1, when 0 < x < ir, 

= 0, when t < x < 27r. 

107. Complex Fonn of Fourier Series. The Fourier series 


(107-1) fix) = ^ + 2 aw; + sin nx), 

n*"! 

with 

if' if' 

On = - I /(O COS nidi, bn = - I fit) sin rd dt, 

Vj ~r TCj -T 

can be 'written with the aid of the Euler formula* 

(107-2) e** = cos -f- f sin « 

in an equivalent form, namely, 

(107-3) fix) = ^ cne*“, 

oe 

where the coefficients c„ are defined by the equation 
(107-4) c» = ^ 


♦ See Sec, 84, 
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The index of summation n in (107-3) runs through the set of all 
positive and negative integral values including zero. 

The equivalence of (107-3) and (107-1) can be established 
in the following manner. Substituting from (107-2) in (107-4) 
gives for n > 0 


1 r 

-ijj 


f(t) (cos nt — i sin nt) dt 


fit) cos nidt- ^J_/(O sin nt dt 

bn 


-i 

"2 *2 


A similar calculation for n < 0 gives 


-L 

= j+ 1-2’ 


while 


Co 


do 




Now (107-3) can be written in the form 

w oo 

fix) = Co -h ^ CnC’"® -f ^ c_»e" 

n"l n*“l 

Making use of the expressions for the c„ just found gives 

fix )=f 


do 

"2 


n»l n«»l 

«o 


+ ~ ^ 

n—1 n“3 

Recalling that 

g-tu 2 cos -M and = 2i sin % 

gives 


fix) 


do 


+ w + &n sin nx), 


ft-i 


which establishes the identity of (107-3) with (107-1)* 
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PROBLEM 

Show that the Fourier series in the interval {-1,1) can be written in 
the form 

»“ + » 

/(*) V, c„e * , 

where 

1 _ inict 

Cn 

108. Differentiation and Integration of Fourier Series. It was 
proved in Sec. 101 that the Fourier coefficients of any integrable 
function defined in the interval (—tt, w) form a null sequence. 
A more precise bound for the magnitude of the Fourier coeffi¬ 
cients can be obtained if the function /(x) satisfies the conditions 
of Dirichlet in the interval (—ir, v). The requirement that 
/(x) have only a finite number of maxima and minima is equiva¬ 
lent to saying that the interval (— w, tt) can be divided into a 
finite number of subintervals in each of which the function is 
monotone. Consequently, 

1 r* 

(108-1) a« = - I f(x) eoBnxdx 

can be expressed as the sum of a finite number of integrals of the 
form 

(108-2) 

in each of which /(x) is a monotone function. 

The application of the second mean-value theorem for integrals 
(Sec. 37) to (108-2) gives* 

J^VC®) cos nx dx = cc® ^ + /(^~ cos nx dx 

— ~ 

““ n 

f(j )■ ■)(sin — sin n^) 

n 

* The symbols f(a+) and /(b-) are used instead of /(a) and /(5) since 
the function may be discontinuous at the end points. 
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IJ fix) cos nx dx < —• 

Since (108-1) is expressible as the sum of a finite number of 

integrals of the form (108-2), it is clear that On is of order* i. 

An entirely similar argument can be carried through for 6^. 
This proves the following theorem: 

Theorem 1. The Fourier coefficients an and bn of a function 
fulfilling the conditions of Dirichlet in the interval (—tt, t) satisfy 
the inequalities 


|a„l < — and 
n 


IT. I 


where M is a 'positive number independent of n. 

If the function fix), defined in the interval —v^x^t, 
is periodic and has the derivative which satisfies the conditions 
of Dirichlet in the same interval, then the Fourier coefficients 

are of order For, 


a.. 

—1C 

- sh 

.-If 

mcj ~ 


f{x) cos nx dx 


f{x) sin nx 


- —P/' 


{x) sin nx dx 


f{x) sin nx dx. 


From Theorem 1 it follows that 


sin nx dx 


is of order so that 
n 


1 M 

*F{n) is said to be of order “if |F(n)| ^ -r* where M is independent 

nr nr 

of n. There are other definitions of the phrase <>/ the orde^ of; see, for 
example, Whittaker and Watson, Modem Analysis, p. 11, 
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A similar argument proves that 


li'nl < — 


This result can be extended readily to establish 
Theorem 2. If the function f{x) is periodic and has k — 1 deriva¬ 
tives in the interval and is suck that its kth derivative 

satisfies the conditions of Dirichlet in the same interval^ then the 
Fourier coefficients for f(x) satisfy the inequalities 

„)b+l and |5„1 < 


where M is a positive number independent of n. 

It should be noted that the requirement that the derivatives 
of the function f{x) exist implies the continuity of the function. 
Moreover, since f(x) is continuous in the interval —Tt < x < r, 
the periodicity condition requires that/(— t) = /(tt). 

An important conclusion follows directly from Theorem 2. 
Consider a periodic function f{x) which is continuous in the 
interval (•— t, t ) and whose first derivative f{x) satisfies the 
conditions of Dirichlet in the same interval. The Fourier 

series for such a function has coefficients of order so that 


= 1^ + 2 ^ sin «a:) 


n »1 


+ 


n«l 


n-l 

where AT is a positive number independent of n. 

This inequality states that the terms of the Fourier series 
are numerically less than the corresponding terms of a convergent 
series of positive constants. Hence, the series 


f(x) ^ +'^{on <ioa nx + hn sin tut) 
||«»1 
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converges uniformly* in the interval (-tt, it). Accordingly, 
the Fourier series for a function whose derivative satisfies the 
Dirichlet conditions can be integrated term by term. 

It is obvious that the differentiation of a trigonometric series 


(a„ cos nx + bn sin nx), 


term by term, produces a trigonometric series whose coefficients 
are of the order of Tia„ and nb*, so that the differentiated series 
win converge less rapidly if at all. For example, the series 
resulting from term-by-term differentiation of the seriesf 
representing the function/(a:) = x, (—ir ^ a: t), 


(108-3) 


2( sin X 


sin 2a: , sin 3a; 
“2 3 


2(cos X — cos 2a: -f- cos Zx ), 

which diverges for all values of x. 

On the other hand, term-by-term integration of the same 
series between the limits 0 and a: gives the series 




COS 2x 

cos 2x , 


, c os 3 x * 
~3^'o 
cos dx 
3^ 


/i-i-fi 

\ 2* ^ 3* 


SO that 




SW - ^ - 22 


.COS nx 


* See Sec. 71. 
t See Example 1, Sec. 104. 
t See Prob, 5, Sec. 104. 
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which is precisely the Fourier series for ^ in the inteiral 

— TT ^ X W.* 

Now despite the fact that the series (108-3) does not converge 
uniformly, the term-by-term integral of this series converges 
to the value of the integral of the function defined by (108-3). 
This is not an accident, and it is possible to prove that whenever 
f{x) is represented by a Fourier series, so that 


then 


= ^ + ^2 (a„ cos nx + sin nx), 


n— 1 



/: 


do 




{dn cos nx + hn sin nx) dx. 


In other words, the Fourier series representing f(x) can always 
be integrated term by term regardless of whether the given 
series converges uniformly or not.t 
However, great care must be exercised in differentiating the 
trigonometric series term by term. If f{x) is periodic and 
continuous in the interval — t < a; ^ tt, and its derivative of the 
second order satisfies the Dirichlet conditions in the same 
interval, then the Fourier coefficients of f{x) will be of order 


1 . 


The series obtained by differentiating the Fourier series 


for f(x) will have coefficients of order -jj and consequently it 

n 


will converge uniformly. Under such circumstances the term- 
by-term differentiation is clearly legitimate. 

109. Fourier Integral. The theory developed in Sec. 106 
permits one to write the Fourier series of a function f{x) which is 
defined in the interval (—Z), where Z is finite but can be made 


* See Prob. 1, Sec. 104, 

tThe proof of this remarkable fact will be found in a paper by E. W 
Hobson in the Journal of the London McUhematicdl Societyj vol. 2, p. 164,1027 
See also C. J. de la Valine Poussin, Cours d’analyse infinit^simale, vol. 2. 
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as large as desired. The limitiag form of the series (106-2), 
when I is allowed to increase indefinitely, can be written in the 
form of an integral. It will be assumed here that the function 
f{x) satisfies the conditions of Dirichlet in any interval (—!, 
where I can be made as large as desired, and that the integral 


converges. 

Since /(x) is assumed to satisfy the conditions of Dirichlet* 
in any interval (~Z, Z), it follows that 

ao 

(109-1) /(*) = 1 + 2 ("” ^ + sin 

where 

^/(O cos ^ dt, hn = fit) sin ^ di. 
Substituting these values of the coefficients in (109-1) gives 

(109-2) fix) = l£/«) dt + 72 dt. 

n-1 

Since /:. Jfix)\ dx is assumed to be convergent, 

|iJ_^/(<) d<| ^ ^J_j/(<)l dt ^ 

which obviously tends to aero as I is allowed to increase indefi¬ 
nitely. 

Now, if the interval (—Z, 1) is made large enough, the quantity 

which appears in the integrands of the sum, can be made as 

small as desired. Therefore, the sum in (109-2) can be written 
as 


* is not continuous at the point x 
of (109-1) means MI/(*o+) 


Xo, then the left-hand member 
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(109-3) 


/(^) cos Aa{t — x) dt 

+AaJ f(t) cos 2Aa(t — x) dt 

+ . 

+AaJ* fit) cos nAait — a:) dt 


where 


This sum suggests the definition of the definite integral of 
the function 


Fia) = 


in which the values of the function F(a) are calculated at the 
points 


T 27r 3ir 

r T' j’ 


Now for large values of I 


differs little from 


cos a(t — x) dt 
f"‘^f(t) cos a(t — x) dt, 


and it appears plausible that as I increases indefinitely the sum 
(109-3) will approach the limit 




f(t) cos a{t — x) dt. 


If such is the case, then (109-2) can be written as 
(109-4) fix) = - I da I fit) cos ait - x) dt. 

TJO 
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The foregoing discussion is heuristic and cannot be regarded 
as a rigorous proof that/(a:) is capable of the integral representa¬ 
tion (109-4). However, the validity of the formula (109-4) 
can be established rigorously,* if the function f{x) satisfies the 
conditions enunciated above. The integral (109-4) bears the 
name of the Fourier integral. 

The formula (109-4) assumes a simpler fornl if /(x) is an even 
or an odd function. Thus, expanding the integrand of (109-4) 
gives 

(109-5) fix) = - I da\ fit) cos cd cos ax dt 
^Jo J — 00 

+ - I da I fit) sin at sin ax dt. 
0 ^ — 00 

Now if f(t) is an odd function, then the function f(t) cos at will 
be also odd. Therefore, for an odd function /(a;), (109-6) 
reduces to 


m = li 

^Jo 

since the first integral in (109-5) vanishes. Moreover, since 
f(t) sin at is an even function when f(t) is odd, the foregoing 
integral can be written as 




dot I f(t) sin at sin az dtj 


(109-6) fix) \ da\ fit) sin at sin az dt 
^Jo Jo 

An entirely similar argument proves that if fix) is an even func¬ 
tion, then 

(109-7) fix) -I da\ fit) cos at cos ax dt 
^rjo Jo 

If fix) is defined only in the interval (0, tt), then either (109-6) 
or (109-7) can be used, since the function fix) may be thought 
to be defined in the interval (—t, 0) so as to make it either even 
or odd. However, it must be remembered that at the points of 
discontinuity the integrals in (109-6) and (109-7) converge to 
}4lfixo+) + fixo — )], so that for x = 0 the formula (109-6) 
will always give the value 0. 

* See Cakslaw, H. S. Fourier's Series and Integrals, p. 283. 
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PROBLEMS 


1. Set fix) = e-» in (109-6) and show that 


r a sin OX , x 

J. T+3'*'-2‘’’ 

if 

a: > 0. 

2, Take 



fix) = 1, if 0 

= 0, if X 

> 1 

<1; 

and show, with the aid of (109-7), that 



1 “sin a cos ax , x 

1 ^ = o' 

Jo a 2 

if 

0 ^ X < 1; 

IT 

= 4' 

if 

X = 1; 

= 0, 

if 

X > 1. 

3. Show, with the aid of (109-6) and (109-7) 

, that 

r *a sin ax - « . 

1 ^ da ^ 

Jo a^+fi^ ’ 

. if 

^>0-, 

r “ cos 0!X , X . 

J, 

if 

>0. 


Hint: Take f(x) = 

4, Show that the Fourier integral can be written in the form 


fix) = 





6, Consider the equations 

f(x) cos xt dx = F{t) 

and 

<p(x) sin xt dx == $(f), 

where F(x) and are known functions and f(x) and <p(x) are the 
functions to be determined. The equations in which an unknown func¬ 
tion appears under the integral sign are called integral equations. Show 
with the aid of (109-6) and (109-7) that 



414 


advanced calculus 


§109 


and 


ip{x) 


- I <J>(t) sin xt 
vjo 


^ the solutions of the given integral equations. Note particular y the 
SS^ble Tom of thlse solutions. The integral equations of this 
problem are called the irdegral eguatvms of Founer. 
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IMPLICIT FUNCTIONS 

110. A Simple Problem in Implicit Functioiis. The purpose of 
this and the next two sections is to present a simplified formal 
treatment of some of the important problems arising in the 
theory of implicit functions. These problems are investigated 
in some detail in the subsequent sections where sharper definitions 
and restrictions on the type of fimctions to be considered are 
supplied. 

A simple instance of an implicit functional relationship is 
that of the form 

(110-1) F(x, y) = 0, 

where, corresponding to a certain range of real values of x, 
the equation (110-1) defines a set of real values of y. In particu¬ 
lar, let (* 0 , yo) be a pair of values which satisfy (110-1), so that 

F(x(i, yo) = 0, 


and denote the totality of values of y, corresponding to a given 
range of values of a: in the vicinity of a; = xo, by 

(110-2) y = fix). 

A question of practical importance will be considered next. 
Under what circumstances can one obtain a solution of (110-1) 
in terms of x in the neighborhood of (xo, 2/o)? If the fimction 
fix) can be expanded in Taylor’s series about the point x = Xo, 
then 


(110-3) y = fix) = /(a:#) -|- f (xo)(a! - * 0 ) + 




a;o)” + 


The coefficients > (» = 1, 2, • ■ • ), appearing in (110-3) 

can be calculated from the known relationship (110-1) by the rule 

for differentiation of implicit functions. 

415 
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The differentiation of (110-1) with respect to x gives 

^ + = 0 
dx dy dx 


and, if 5 ^ 0 at the point (a;o, j/o), then 


dx 


if(xe) = 


F,(a:o, yo) 

Fvixo, yoY 


The value of f”(x) &tx = xo can be calculated from the formula 


(110-4) 


% F,(a;, y) ^ 

dx Fy{x, yY 


which implies that Fy does not vanish in some neighborhood 
of the point (xo, yo). Then 


(110-5) 


n(?_+^’„g) 

FI 


and making use of (110-4) leads to the formula 


dx^ ^ FI 

provided that the inversion of the order of dififerentiation is 
legitimate.*** 

The formula (110-6) can be used to calculate the f"(xo) appear-, 
ing in (110-3), since the values of the second partial derivatives 
at the point (xqj yo) can be calculated from the given function 
F{x, y). The value of f”\x) at a; = can be calculated with 
the aid of (110-6), and so on. In this manner one can construct 
the solution of (110-1) foj y in the neighborhood of the point 
(xo, 2/o) in the form (110-3). The essential feature of this dis¬ 
cussion is the requirement that Fy{x, y) does not vanish in the 
vicinity of the point (xo, yo). 

As an illustration of this approach to the problem of implicit 
functions consider the task of obtaining the solution of 

x^ + y^^ 6, 


* See Sec. 31. 
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which is valid m the vicinity of the point (2, 1). 
gives 


(110-7) 


# X 

dx y 


Differentiating again gives 


Noting that 


( 110 - 8 ) 


^ y ~ y'x _ + y^ 

dx^ y^ ^ 


where the last step is obtained by substituting the expression 

for y' from (110-7). The expression for ^ can be calculated 

ax^ 

from (110-8); thus, 

d^y _ 2yy + 2xy^ - 3yV{x^ + y^) 
dx^ . 

3x{x^ + y ^) 


Obviously, the process of successive differentiation can be 
continued, in this case, as many times as desired. Substituting 
X = 2 and y = 1 in the formulas for the derivatives just obtained 
gives 

/(2) = -2, /"(2) = ~5, /"'(2) = ~30, 

so that the solution (110-3) becomes 

(110-9) y = l-2(x-2)- |j(a: - 2)* - |5(a: - 2)» 

+ 

Of course, the solution of 

x^ + y^=^ 5 , 

in the vicinity of the point (2, 1), could have been obtained by 
elementary algebra to give 

y = 

which upon expansion in the series of powers of a; — 2 will 3 deld 
the injSnite series (110-9). 



418 ADVANCED CALCULUS §111 

111. Generalizatioa of the Simple ftoblem. The discussion of 
Sec 110 may be generalized in two directions: 

(o) A greater number of variables may be introduced in the 

functional relationship (110-1); 

(b) The number of functions may be increased. 

As an instance of the generalization of the first type, consider 
a relationship of the form 

(111-1) Pix, y, 2) = 0 , 

and assume that corresponding to a certain region of values of x 
and y in the neighborhood of the point (xo, yo) the equation 
(111-1) defines the function 2 , say 

(111-2) 2 = y )- 

It is understood that (111-2) is such a solution of (111-1) that 
F{xo, Vo, zo) = 0. 

AaaiiTning , as in the case of the simple problem treated in 
Sec. 110, that f{x, y) can be expressed in the form of Taylor’s 
series, namely, 

(111-3) 2 = f(xo, yo) + - yo) 

+ • • * , 


one can calculate the partial derivatives entering in (111-3) 
from (111-1). Thus, 




and since x and y are assumed to be independent variables, it 
follows that 


(111-4) 


dx 


dx 




dz 


dy 


dz 


unless — vanishes in the neighborhood of (aio, yo, «o). 
oz 

The substitution of a: = * 0 , p = yo, 2 = Zo in (111-4) yields the 
coefficients of the linear terms appearing in (111-3). The 



5111 


IMPLICIT FUNCTIONS 


419 


coefficients of the higher powers of a; — xo and y — yo can be 
calculated successively with the aid of the formulas (111-4). 

bF 

Again, it should be noted that it is necessary to demand that — 

does not vanish in some neighborhood of the point {xo, yo, zo), 
if the formulas (111-4) are to have a meaning. 

As an example of the generalization of the second type, con¬ 
sider a pair of equations 

/111 (Fix,y,u,v) = 0, 

\Gix,y,u,v) = Q, 

which connect four variables x, y, u, and v. Let it be assumed 
that there exists a set of four real numbers xo, yo, «o, »o such that 


F{xo, yo, uo, Vo) s 0, 


and 


G(xo, yo, Uo, Vo) = 0. 

Further, suppose that the equations (111-5) can be solved in the 
vicinity of the point (xo, yo, uo, vo) to yield 

fu = f(x, y), 

I V = g{x, y), 


( 111 - 6 ) 


which are so chosen that 


, (uo ■■f(xo,yo), 

|»o =9(2:0, yo). 

If the functions f(x, y) and g(x, y) possess sufficiently good 
properties to admit of power-series expansion in the neighborhood 
of the point (xo, yo), then one can write 

[u = fixo, yo) + - Xo) + (^0/ - yo) 

• • O 

( 111 - 8 ) /- \ /;>/,\ 

g(xo, yo) + * 0 ) + - yo) 

+ • 

The values f(xo, yo) and gixo, yo) are known, since the left-hand 
members of (111-7) are prescribed in advance. The coefficients 
of the linear and higher powers of x — xo and y — yo can be 
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determined by the differentiation of equations (111-5), where 
u and V are regarded as functions of the independent variables 
X and y. 

Thus, differentiating equations (111-5) with respect to x 


dG , ^ du , dG dt/ _ ^ 
dx du dx dv dx 

Solving this system for and ~ by Cramer^s rule provides 


dx 


dx 




dF 


dF 

dF 


dx 

dv 


du 

dx 


dG 




dG 

du _ 

dx 

dv 

dv 

du 

dx 

dx ~ 



dx 




du 

dv 


du 

dv 


du 

dO 

dv 


du 

dG 

dv 


Now, if the denominator 


( 111 - 10 ) 


\dF 


du 

dv 



du 

dv 


does not vanish for (xo, yo, «o, vo), the values of 

can be calculated from (111-9). Similarly, the differentiation of 
equations (111-5) with respect to y will yield formulas for — 
dv 

and — which are analogous to (111-9) and which contain the 

same determinant J in the denominator. 

powers of a: - ®o and y ~ yo in 
Ull-8) can be calculated with the aid of the expressions for 
the first partial denvatives. It is obvious that the success of 
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this scheme depends on the nonvanishing of the determinant 
(111-10) in the neighborhood of the point (a;o, i/o, Uo, Vo). 

An entirely similar consideration of the set of three equations 

{ Fix, y, z, u, V, w) = 0, 

(111-11) ’ Gix, y, z, u, V, w) = 0, 

[Hix, y, z, u, V, w) = 0, 

shows that the determinant 


( 111 - 12 ) 



dF 


du 

dv 

dw 

j _ dG 




dv 

dw 

m 

m 

m 

du 

dv 

dw 


plays the same role in the problem of solving (111-11) for u, 
V, and w in terms of x, y, and z as (111-10) did in the simpler case. 

The determinants of the form (111-10) and (111-12) are called 
Jacobians, and they are fundamental to all of the investigations 
of this chapter. 

A particular form of the functional relationship (111-5) is of 
frequent occurrence in geometry. Let 


(111-13) 


'x = <piu, v), 
y = ^{u, v), 


be regarded as the equations of transformation which establish a 
relationship between a set of points of some region of the a^-plane 
with the corresponding set of points in the M»-plane. It wUl be 
assumed that there is a one-to-one correspondence of the points 
of the region in the xy-plane with those of the Mf>-plane. Let 
it be required to obtain from (111-13) the inverse transformation, 
namely, 


(111-14) 


w = y), 

V ■■ gix, y). 


The equations (111-13) can be put in the form (111-5) by 
writing them as 

Fix, y, u, v) ’■ <piu, t>) — X = 0, 

Gix, y, u, ») s ^(u, t>) - j/ = 0. 
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Hence, if the scheme outlined above is to be available for the 
calculation of the inverse transformation, it is necessary to 
demand the nonvanishing of the determinant 


(111-15) 


d<p 

d<p 

du 

dv 

dip 

d\p 

du 

dv 


It is clear that a similar consideration applied to a set of n 
equations of transformation of the form 


(111-16) 


'Ml = Mi(a:i, Xt, , Xn), 

\Ui = Ui{Xi, Xi, , Xn), 

^V/n “ V/niXiy X2] * ' ' j ^»)j 


will lead to a consideration of the determinant 


(111-17) 


dui 

dui 

dui 

dXi 

dXa 

dXn 

dU 2 

dU 2 

dU2 

dXi 

dXz 

dXn 

dUn 

dUn , , , , 

dUn 

dxi 

dX2 

dXn 


It is interesting to note that if the equations of the transformation 
(111-16) are linear, so that 


Ui = OiiXi + OiiXi -f • • • -f Oi^n, (t = 1, 2, ■ - • , n), 

then (111-17) is precisely the determinant of the coefficients 
of the x^a, namely. 



®12 

.... ain 


^22 

.... a^n 


an% 

• • » » Otnn 





§113 


IMPLICIT FUNCTIONS 


423 


and it is well known that in obtaining the solution for the vari¬ 
ables Xf in terms of the Ui, it is necessary to demand the non¬ 
vanishing of the determinant A. 

112. Functional Dependence. Another important problem 
arising in the study of implicit functions is that of the functional 
relationship that may exist among a set of functions. As a 
simple example of such a circumstance, consider a pair of real 
functions 


( 112 - 1 ) 


y), 

« = 9 (x, y), 


of the variables x and y, defined in some region R of the xy-plane. 
It will be supposed that the functions u and v, together with 
their first partial derivatives, are continuous in R. Further, 
suppose that there exists a functional relationship between the 
functions u and v of the form 


(112-2) Fiu, v) = 0, 

such that 

(112-3) F[fix, y), gix, y)] 0. 

The identity sign in (112-3) means that the left-hand member of 
(112-2) annuls itself for all values of x and y in the region R 
when /(x, y) and g(x, y) are substituted for u and v, respectively. 
Differentiating (112-2) with respect to x and y gives 


(1124) 


du dx dv dx 
dF du , dF dv 
du dy dv dy 


The equations (1124) may be looked upon as a set of two homo- 

. dF , dF „ dF ,dF 

geneous linear equations m — and Now — and cannot 

both vanish identically in R, since this would imply that F{u, v) 
is independent of u and v. Consequently, if F is to be a function 
of u and v, then the system (1124) must possess nonzero 

solutions for — and ^; hence, the determinant of the coefficients 
du dv 

.dF ,dF , 
of -;r- and —> namely 
du dv 



424 


ADVANCED CALCULUS 


du 


dx 

dx 

du 

dv 

dy 



ilia 


must vanish for all values of x and y in the region R. These 
considerations can obviously be extended to cover the case of a 
set of n functions Ui{xi, • • • , a:„) of n independent variables 

Xi, Xi, • - • , Xn. 

It appears from this formal investigation that the vanishing 
of the Jacobian is a necessary condition for the existence of a 
functional relationship among a set of n functions Ui(xi, ® 2 , ■ • • , 
x„), and it will be shown rigorously in Sec. 115 that this condition 
is both necessary and sufficient. 

As a specific illustration of the foregoing consider the set of 
three functions 


(u = x + y + z, 

(112-5) = xy -f- yz + zz, 

(w = x’ + y^ + z^. 

It is easily checked that 

F(u, V, w) ^ — 2v — w = 0. 

The Jacobian of (112-5), namely, 

|1 y + z 2x1 


1 X + z 2y 0 

jl y + X 2z! 

as it should be. 

On the other hand, the relations 


give 


u - X* — y*, 
V = 2xy, 

2x 2y\ 


-2y 2*1 


4 (®* + »»), 
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Sin 


which obviously does not vanish identically in any region B, 
so that u and v cannot be connected by means of any analytic 
relationship of the form F(u, t>) = 0. 

113. Existence Theorem for Implicit Functions. It is the 
purpose of this section to furnish a rigorous discussion of the 
problem which was treated formally in Sec. 110. Let F{x, y), 
regarded as a function of two independent variables x and y, 
be such that for x = xo and y = yo 


jP(*o, yd) = 0. 


Consider a rectangular region (Fig. 89) bounded by the lines 


a: = Xo i ft} 
y = yo ± k, 

and suppose that correspond¬ 
ing to every value of x in the 
interval (xo — ft, Xo + ft) there 
exists one, and only one, value 
of y lying in the interval 
(yo — k, yo + k) such that 

(113-1) F(x,y) = 0. 



Under these circumstances 

the equation (113-1) is said to define y as an implicit function 
of X. If this function be denoted by the symbol 


then 


y = /(*), 

yo = f(xo). 


and the latter is called the solution of (113-1) for y in terms of 
X at the point (xo^ yo)- 

The following existence theorem is of fundamental importance 
in all considerations of this chapter. 

Theorem 1. Let xo he any real value of z such that: 

(a) F(xo, y) = 0 has a real solution yo, that is, 

Fixo, yo) = 0; 

(b) F{x, y), regarded as a function of two independent variables 
X and y, is corUinuous and has cordinuous partial derivatives 
Fm{x, y) and Fy(x, y) in some region B enclosing the poini (xo, yo); 
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(c) Fv(Xii, l/o) 5^ 0; . „ s 

then F(x, y) = 0 can he solved (theoretically) as y 

vicinity of x = Xo in such a way that 

yo = /(aJo). 


= f(x) in the 


Moreover, the solution is unique and is such OM V - fi^) « 
continuous derivative in the vicinity of x = xo which is given hy the 

formula 


F^{x,y) 

■ “JvCT 


Since F(x, y) is assumed to be continuous in some repon 
containing the point (xo, yo), the function F(xo, y), obtained 
from F(Xj y) by setting x = xo, is a continuous function of y. 

Furthermore, at (xo, yo), so that the function F(xo, y) 

is increasing in the vicinity of y = yo if F„(x(,, yo) > 0, and is 
decreasing if Fy(xo, yo) < 0. But F(xo, yo) = 0; hence, the 
function F(xo, y) must change sign at y — yo- For denmteness 
let Fy(xo, yo) >0; then there exists an interval (yo - S, yo + 8) 
such that the function F(xo, y) is negative for all values of y 
such that 


yo — 8 ^ y < yo. 


and is positive whenever 

yo<y ^yo + 8. 

Furthermore, F(x, yo - 8) and F(x, yo + 8) are continuous 
functions of x, and for x = xo the function F(x, yo - 8) is nega¬ 
tive. (Consequently, there exists some interval (®o — 8', Xo -f 8') 
about the point x = Xo such that F(x, yo - 8) <0 for all values 

of a: in this interval. 

Similarly, F(xo, yo + 8)> 0, so that in a sufficiently small 
interval about the point x = xo, F(x, yo + 8) will be positive. 
Let this interval be (xo — 8'^, Xo + 8"), and if 5i is the smaller 
of the two numbers 5' and 5", the functions F(x, yo - 8) and 
yo -t- 8) will have opposite signs for all values of x that are 
interior to the interval (xo — 5i, xo + 5i) (Fig. 90), 


* See Sec. 22. 
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Let a: = *1 be any value of x in the interval {xo - Si, xo + Si); 
then, since F{xi, yo — 3^ and F(xi, yo + 5) are of opposite signs, 
there will be some value of y, say y = yi, where 

yo — S < yi < yo S, 

such that 

(113-2) F(xi, yi) = 0. 

The value of y satisfying (113-2) depends upon the choice of x, 
and, since for each value of x that is interior to (a:o — 3i, xo -f 3i) 



there is determined a value of y satisfying F{x, y) = 0, one can 
write 

y = /(a;). 

The continuity of y = f(x) in the vicinity of a: = xo follows 
from the fact that for all values of x in the interval (xo — Si, 
Xo + 6i) the equation 

F{x, y) = 0 

has a solution y = f{x)j for which y lies between yo ^ and 
^0 + 

At this stage of the proof one cannot assert that there is but 
one value of y corresponding to the choice x = xu In order 
to establish the uniqueness of the solution, the hypothesis of 
the continuity of Fy(x, y) in some region enclosing the point 
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(xo, yo) will be utiHzed. If Fyix, y) is continuous in the vicinity 
of ’(xo, 2/o) and is different from zero at (xo, J/o), then it will be 
different from zero at all points sufficiently near (xo) j/o)- Now, 
if in the foregoing discussion S and Si are chosen so small that 

Fyix, y) 9^0 when N - a:ol < h and \y - yo\ < S, 

then the function 

F(xi, y), where Xo — Si < < a:o + 5i, 

will be either increasing or decreasing for all values of y in the 
interval (yo - S, l/o + «)• Under these circumstances F{xi, y) 
cannot vanish for more than one value of y. 

In order to establish the continuity of the derivative of 
y = fix) in the vicinity of x = Xo, let (x + Ax, y + Ay) and 
(x, y) be a pair of solutions of Fix, y) = 0. Then 

Fix + Aa;, y + Ay) - Fix, y) = 0 

and, obviously, 

Fix + Ax, y + Ay) - Fix + Ax, y) + Fix + Ax, y) 

- Fix, y) = 0. 

By hypothesis F^ix, y) and F„(x, y) are continuous functions 
in some region R about (xo, yo). Therefore, from the mean-value 
theorem,* it follows that 

AyFyix + hx,y -{■ 01 Ay) + AxF *(x -|- Bz Ax, y) = 0, 

where 0 < Si < 1 and 0 < Sa < 1. Solving for ^ gives 

^ _ Fxjx -b Bj Ax, y) 

Ax Fvix -f Ax, y -b Si Ay) 

and, letting Ax —» 0, one obtains 

dx Fyix,jyy 

since jP„(x, y) 5 ^ 0 for every point (x, y) in the region B. 

If the assumption of the continuity of F^ix, y) is abrogated, 
one cannot assert that the solution y = fix) will possess a con- 


* See Sec. 20. 
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tinuous derivative in the vicinity of a; = Xo. However, the 
solution y = f{x) will be unique and continuous under the 
hypothesis that y) is continuous in the neighborhood of 
(xqj yo) and is different from zero at the point (xo, yo)- It is 
not diflSicult to demonstrate the existence of a unique solution 
on the hypotheses that Fyixo, yo) is different from zero and 
Fy(Xy y) does not change sign in the vicinity of (xo, yo).* 

An argument in every respect similar to the foregoing permits 
one to generalize Theorem 1 to include the case of functions 
of more than two variables. Thus, one can enunciate the 
following theorem: 

Theorem 2. Let the function F(xi, xa, • • • , x^, u) satisfy the 
following conditions: 

(а) jP(xi, Xa, • • • , Xm, u) has a real solution u^ for Xi = xj, 

Xa = Xa, * ’ * > Xm == x„j, 

(б) jP(xi, Xa, • • • , Xfl», ti), regarded as a function of them + 1 
independent variables Xi, Xa, • • • , Xm, u^ is continuous and has 
continuous partial derivatives FxijFxij • • • , FFu in some region 
of space enclosing the point (xj, Xa, • • • , xS», u ^); 

(c) Fuixl xl ■ , xi, u^) 9^0. 

Then F(xi, Xa, • , x^, u) = 0 can be solved in the vicirdty of 

(xj, xS, • * • , xi) to yield 

u = /(xi, Xa, • • • , x«) 

in such a way that 

u^ = /(x?, xS, • • * , xi). 

The solution u = /(xi, Xa, • • • , x J is unique and is continuous 
in the vicinity of the point (x?, Xa^ — • together with its first 
partial derivatives, which are given by the formulas 


du ^ 

Fn(Xi, Xi, ' • ■ 

, Xmy 'Of) ^ 

dXi 

FuiXi, Xi, • • • 

, Xm) 

du _ 

Fs,(xu Xi, • • 

, Xmy '^) ^ 

dxa 

Fu{xi, Xi, • ‘ • 

, Xm, -u) 

du __ 

F„^{xi,Xi, • • 

, Xm, 

dXm 

Fu{xi, Xi, • • 

• , Xm, «) 


♦ See Hobson, E. W., Functions of a Real Variable, vol. 1, Secs. 316,316S 
pp. 432--436. 
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114. Existence Theorem for Simultaneous Equations. 
Theorem. Let a system of n equations 

(114-1) Fi(xi, Xi, • ■ • , Xm, Ui, Ut, • • • , Un) = 0, 

(i = 1, 2, • • • , n), 

in m n variables Zi, Zs, • • • , Zm, ui, Us, • • • , Un have a real 
solution Zi, zl, • • • , Zm, m?, u\, • • ' , u%, so that 

(114-2) Fiizi, zl, • ■ ■ , zl, ul, ul ■ • • , K) = 0, 

(i = 1, 2, ■ , n). 


If the functions 

Fi(Xi, X2j ••• 3 Wl? WSj • * * ? ^n)> 

regarded as functions of m + n independent variables, are con¬ 
tinuous and have continuous first partial derivatives in some region 
R of the m + n dimensional space enclosing the point P, whose 
coordinates are (xl, xl, • • • , xl^, ul, ul, * 3 ul), and if the 


Jacobian 

dFi dFi dFi 

^Bux Buz dUn 

BF 2 dF2 dF^ 

j _ B(Fi, F 2 } ' * * 3 Fn) ^ \dui Bu% BUfij 

BFn dFn OF, 

\BUi BU2 dUn\ 

is different from zero at the point P, then the set of equations (114-1) 
can be solved as 

(114-3) Ui = fi(p^l 3 1 ^iw)? (f ^3 ^) * * * } 

in the vicinity of the point P in such a way that 

u\ = fiixl, xl, ^ , xl), ii = 1, 2, • • • , n). 


Moreover, the set of solutions (114-3) is unique and the functions 
Ui are continuous together with their first partial derivatives in 
the neighborhood of the point (xj, xl, • • • , x^). 

This theorem has been established in Theorem 2, Sec. 113, 
for the case when n == 1, in which the Jacobian reduces to Fuv 
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It is natural to extend this proof to a greater number of functions 
by mathematical induction. Thus, if the correctness of the 
theorem can be established for n functions on the hypothesis 
that the theorem is true for n — 1 functions, then the truth of 
the theorem follows for n = 2, 3, 4, • • • , since the theorem 
is known to hold forn = 1. 

By hypothesis the determinant J does not vanish for the 
particular set of values (zl, xl, • • • , xj,, uj, uE, • • • , uj), 
so that all of its elements caimot be equal to zero. Let it be 
supposed that it is the partial derivative 

dF, 

appearing in J, that does not vanish.* Then it follows from 
Theorem 2, Sec. 113, that the equation 

(114-4) Fn(xi, Xi, ‘ • , Xm, Ml, ^2, Mn) = 0 

can be solved to yield 

(114-6) Un = <p(xi, Xi, , Xm, Ml, Mj, • , 1t„_l), 
in such a way that 

ul = <p{xl, x\, , xi, mS, mE, * • • , M®_i). 

Substituting (114-5) in the first n 1 equations of the set 
(114-1) gives 

(114-6) #i(a:i, Xi, , x„, ui, Ui, • ■ • , m„_i) = 0, 

(f = 1, 2, ■ ■ • , n - 1), 

where 

(114-7) 4>i(a:i, Xi, • • • , Xm, «i, Mj, • • • , m„_i) 

^ Fi{Xl, Xi, * ’ * , Xm, Ml, Mj, ' ' ’ , Mf,— 1 , ^). 

Equations (114-6) and (114-6) are equivalent to the system 
(114-1). Now if the M — 1 equations (114-6) can be solved for 
Ml, Ui, • ’ • , Un-i in terms of Xi, Xi, • • • , Xm, there wiU be 
obtained a set of n — 1 functions 

(114-8) Ui = fi(xi, Xi, ■ ' • , Xm), (f = 1, 2, • • • , n - 1). 

• By reordering the functions (114rl), if necessary, it is always possible 
to achieve this. 
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Substituting from (114-8) in (114-6) gives 
(114-9) Wn “ ' y *^)* 

The set of n functions (114-8) and (114-9) is the desired set 
(114-3). But the set of n - 1 equations (114-6) is of the type 
(114-1), and if it is assumed that the theorem is valid for ti — 1 
functions, then Eqs. (114-6) can be solved for Ui, Uz, , Un-j. 
in terms of Xi, x^, ■ ■ ■ , Xm, provided that 

A = 3(4*1, 4»2, • , 4>n-l) ^ Q 

d(Ui, Wj, • • • , Un_l) 

for (aij, X2, ■ ■ ■ , ^2, ' ■ ■ > i)- 

In order to show that A does not vanish it is desirable to write 
it out explicitly. From (114-7) it follows that 


dUj 

so that 


? + 


SUj 


(t, j = 1, 2, 


n 


1), 


dUi 

dF 2 

\dui 

dui 






dFi 

d<p 

dFi 

-1- 

dFi 

dtp 

aFi 

M 

dFi 

dtp 

dUn 

dui 

duz 


dUn 

duz 

dv„-i 


dUn 

dUn^l 

BF 2 

dtp 

dFz 

4- 

dFz 

dtp 

dF, 

4- 

dF, 

dtp 

dUn 

dui 

dUz 

1 

dUn 

dUz 

dv>nr~l 


dUn 

dWn-l 

aFn-1 

dtp 

dF n~l 

, t. 

dFn-.i 

dtp 

dFn^l 

-i- 

3F._, 

dtp 

dUn 

dui 

dUz 


dUn 

duz 

dUn-l 

dM„ 

dUn^l 


Since each element of this determinant is made up of the sum of 
two terms, A can be expressed as the sum of 2^’*^ determinants.* 
Some of these 2"'"^ determinants will contain two columns that 
are proportional, so that they will vanish, and the remaining 
ones give 

(114-10) A I 

d(Ui,U2j ,Un-l) dUid{UnfU2, * * ' , Wfi-l) 

+ + , Fn^x) 

dUn~ld(Wi, 1^2, • * • , t^n-2, Wn)* 

' It will be recalled that 



di Cl di 


hi Cl di 


dz Cz dz 

+ 

hz Cz dz 


dz Cz dz 


hz Cz dz 


di + hi Cl di 
dt + fea Cl da 
d$ 4* hz cz dz 
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The expressions for 


d<p dip 

dUi dUz dUn~^l 

which appear in (114-10), can be obtained as follows. Recalling 
(114-5) and applying the rule for the differentiation of implicit 
functions to (114-4), one finds 


^ = 0 
dUi dUn dUi 


Hence, 


dip 

dm 


a = 1,2, 


dFn 

dUi 

dFn 

dUn 




On substituting these expressions for the in (114-10) and 

dF 

multiplying both sides of the resulting equation by there 
results 

dFn ^ d(Fi, Ft, ••• , Fn-l) . dFn 

dUn d(Uij Vt2i * * ' ; —l) dUn 

— ^(^1> Pit ' ' ‘ y Fn—l) dFn 
d(Un, Ut, , Un-l) dUi 

d(Fi, F2 , , Fn-l) , dFn 

d(Ui, U2, -2, w») dUn-1 

A little reflection shows that the right-hand member of this 
equation is precisely the expansion of the Jacobian J in terms 
of the elements of the last row of J. Hence, 



dUn 


which, by hypothesis, does not vanish at the point P. 

il6. Functional Dependence. 

Theorem. Leltii^ • • • ,Xn), (f=l,2, ,n), 

be a set of n functions of n independent variables Xi, x^, , Xn- 

The functions fi together with their first partial derivatives are 
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assumed to he continuous in some region R enclosing the point 
(xl, xl • • • , xl). A necessary and sufficient condition that 
there exist among these functions a relation 

F(Uij U2j * j Un) ~ 0, 

which does not contain the variables Xij x^, • , Xn explicitly^ 

is that 

J = ,Un) Q 

d{Xi^ XZf • • , Xn) 

for all values of the variables Xi, X 2 , • • • ^ Xn in the region R. 

In order to avoid complications in writing, the theorem will 
be established for the case of three functions 

(u = fi(x, y, z), 

(116-1) V = Si(x, y, z), 

{w = fz(x, y, z), 

since the discussion of this case possesses all features of the 
more general circumstance. 

To demonstrate the necessity of the condition of the theorem, 
assume that the Jacobian 


(115-2) 


d(u, V, w) 
d(x, y, z) 




§fl 

dx 

dy 

dz 

dfi 

dfi 

a/s 

\dx 

dy 

dz 

m 

dfz 

a/, 

dx 

dy 

dz 


does not vanish at some point (xo, j/o, 2o) of the region 22. Denote 
the values of u, v, and w, calculated from (115-1) by setting 
® ~ ®o> y ~ VO) ^ ~ 2o, by «o, »o, and w^. It follows from the 
theorem of Sec. 114 that one can solve (115-1) to give 

X = V, w), 

y = viiv-, V, w), 

2 = V, w), 


where the solution is valid for an arbitrary choice of u, »,.and w 
belonging to some region about the point (uo, »o, Wo). Since the 
choice of the numbers u,v,wm arbitrary, there can no relation 
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F{u, V, w) = 0 

in the region R under consideration. 

To prove the suflBiciency, consider again the set of functions 
(115-1) and assume that (115-2) vanishes identically in the 
region R. Consider first the case where at least one of the 
minors of J does not vanish identically, and assume that such a 
one is 



dh 

dx 

dy 


dfi 

dx 

dy 


Since A ^ 0 in fl, one can solve the first two of Eqs. (115-1) for 
X and y to yield 


(115-3) 


'x = <piiu, V, z), 
y = ipiiu, V, z). 


Substituting these values in the third of JEqs. (116-1) gives 
(115-4) w = <P2, z) = F{u, V, z). 


Now if the right-hand member of (116-4) contains no z, 
then w is a function, of the variables u and v and this will establish 
the sufficiency of the condition for this case. It will be shown 
next that F(u, v, z) indeed is independent of z, since it will be 
proved that 



Calculating this partial derivative from (115-4) furnishes 
(115-6) 


dz 


dft d<p \ , 

dx dz dy dz dz 


But, since (115-3) represents the solution of the first two of 
Eqs. (116-1), the substitution of (115-3) in the first two of Eqs. 
(116-1) yields the identities 


<P2, z) 

/a(f 1, <Pit *) 


«, 
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It is, therefore, evident that <p 2 j and are 

independent of iz, so that 


(115-6) 


dfi d<pi , ^ ^2 [ d/i __ Q 

dx dz dy dz dz 

d /2 d<pi , ^ I d /2 _ Q 

dx dz ' dy dz dz 


Adding to the last colunan of the determinant J the product 
of the first column by ^ and the product of the second column 


by 


d<p2 

dz 


gives the determinant 


dfi dfi dfi d<pi , d^ . ^ 
dx dy dx dz dy dz dz 

d /2 d /2 d /2 d<pi ■ d /2 d<p 2 I d /2 

dx dy dx dz dy dz dz 

dx dy dx dz dy dz Qz 


which, upon noting (115-6) and (115-6), reduces to 



By hypothesis J ^ 0 and A ^ 0, so that ^ ^ 0, 

It remains to consider the case where every minor of second 
order of the determinant J vanishes but where at least one of 
the elements of J does not vanish identically in R, Suppose, 
for example, that 




Then one can solve the first of Eqs. (115-1) for x in terms of y 
and z, so that 


X = <Pi(u, y, z). 

Substituting this value of a: in the last two of Eqs. (116-1) gives 

• t> = f2(vi, y, 2) s F(,U, y, z), 
w = M<Pu Vi 2) = Oiu, y, a), 
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and it remains to show that F and G do not contain y and 
in which event both v and w are functions of w. It wiU be proved 
next that such is the case. 

Now, 

^ 4 - 

dy dx dy dy 


and from the first of Eqs. (115-1) it follows that 


§fl I ^ _ Q 

dx dy dy ' 


From these equations, and from the fact that every minor of J of 
order 2 vanishes, it follows that 



It can be verified in a similar way that 




and 



and hence, both v and w are functions of u. 

The remaining case in which every partial derivative vanishes 
identically is trivial, because in this event the functions Uj v, 
and w reduce to mere constants. 

The extension of this proof to any number of functions is 
obvious. It may be remarked that, if the Jacobian of the n 
functions 


Ui == fi(xij * • • , 2, , n), 

is such that every minor of order greater than r vanishes iden¬ 
tically while at least one minor of order r does not vanish, 
then there will be exactly n — r independent functional relations 
connecting the variables. 

Example. Let 

u X + 2y + Zf 
X - 2y + z, 
x^ + 2xz- 4^2 + 
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1 2 1 


/ = 


1 -2 


1 =0, 


|2(rc + z) —8y 2(x + z) 

so that the functions are dependent. Furthermore, since there 
exists a nonvanishing minor of second order, there is only one 
independent relation. In fact it is = uv, 

116. Properties of Jacobians. Let there be a set of n functions 
Fi, Fs, • • • , Fn of n variables wi, 1 ^ 2 , • • • , ^n, and suppose 
that the variables Ui are not independent variables but are 
functions of some other set of variables Xi, X 2 , • • • , Xn> Then 
it is easy to establish the following interesting formula: 


( 116 - 1 ) 


d(Fi, F2, * * • > i^n) 

d(Xlf ZZf * * * > ^n) 


6(Fi, Fit ••• J Fn) ^ djuij , Un) 

<9(Wl, U2f • ‘ • y Un) d(Xiy X2j • • • t Xn) 


The result (116-1) follows upon multiplying the two deter¬ 
minants in the right-hand member according to the rule for 
the multiplication of determinants.* Thus, 


dFi 

dFi 

dFi 


dUi 

dui 

dui 

dUi 

dU 2 

dUn 


dXi 

dX 2 

dXn 

dFi 

dFi 

dF^ 


dU 2 

dUi 

bUz 

dui 

du% 

dUn 


dxi 

6 X 2 

dXn 


bfn 



du„ 

dUn 

bUn 

dui 

bu% 

dUn 


dxi 

6 X 2 

bXn 


* Note that if the n-rowed determinant in which aaiB the element in 
the tth row and the /th column, is multiplied by the w-rowed determinant 


there results \aij\ • |6<y[ 
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gives the determinant whose element in the ith 
column is 
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row and the jth 


dwi dXj dU 2 dXj du„ dx,- 

The latter is recognized as the formula for For n = 1, 

the formula (116-1) reduces to the simple formula for the deriva¬ 
tive of a composite function, namely, 

dF dF du 
dx du dx 

Another interesting property of Jacobians is worth noting. 
Consider a transformation 

(116-2) Ui = /i(a:i, is, • ■ • , a:„), (i = 1, 2, • • «), 

and denote its inverse by 

(116-3) Xi = tpi{ui, Ui, ' ' ' , u„). 

The Jacobians of (116-2) and (116-3) are 

jr _ ^2, ' * ' j '^«) and ^ _ ^(^ i> , Xn) 

d{Xi, Xi, ’ ■ ■ , iCn) d(ui, Ui, , M„) 

Then, 

J .J ■_ Uj, ' ' ' , u„) djxi, Xj, • ■ • , x„) 

^ * d(xi, Xi, • ' • , Xn) d{ui, Ui, , Un)' 

which, by the formula (116-1), is equal to 


d{ Ul, Ut, • • ■ ,Un) J 
d(ui, Ui, , Un) 

Hence, the Jacobians of the direct and the inverse transforma¬ 
tions are reciprocals of one another. 


PROBLEMS 


1. If 

u = «(«, y, i), 
V = v(x, y, z), 
w = w(x, y, z). 
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d{v, w),Q that one can solve the last two equations for 
assume that A ?= u, bu >- 

j, and 2. SuSltute these solutions in the first equation, and show that 


du _ d(u, V, w) _ d{y, z) 
dx ~ d{x, y, z) d(», w) 


2. Let 


X = x{u, v), 
y = y{u, v), 
z = z(u, v), 


be the parametric equations of a surface from which u and . can be 
eliminated to give 2 = F{x, y). Show that 

^ ^ y'> 

dx " a(u, v) ■ diu, v) 


3. The transformation of inversion in space is given by 

s y __ 


u = 


x^ + y^ + 2 ^ 


x^ + y^ + 2 ’ 


W 


+ 2 * 


Does it possess an inverse? Verify that the product of the Jacobians 
of the direct and the inverse transformations is unity. 
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Abel's test for uniform convergence, 
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Abel's theorem, on interval of con¬ 
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on power series, 276 
Absolute convergence, of integrals, 
337, 341, 344, 349 
of series, 236, 240, 263, 268 
Addition of series, 212, 240, 281 
Adiabatic process, 208 
Alternating series, 234 
Angle, as a line integral, 171 
soM, 171 
Arc length, 127 
Area, as a double integral, 140 
element of, 163, 201 
as a line integral, 178 
of surface, 161 

Associative law for series, 212n. 
Attraction, law of, 172, 202, 369,372 

B 

Bernoulli's inequality, 8 
Bernoulli's numbers, 287, 289 
Beta function, 376 
Binomial series, 301 
Binomial theorem, 301 
Bolzano-Weierstrass theorem, 18 
Bounded sets, 105 
Bounds, 22 
of a function, 23, 106 

C 

Cantor-Dedekind axiom, 3 
Cauchy-Riemann equations, 206 
Cauchy's integral test, 226 


Cauchy's principal value, 347 
Cauchy's product of series, 244 
Cauchy's ratio test, 217n. 

Cauchy's root test, 216 
Cauchy's theorem, 53 
Center of gravity, 137, 159, 165 
Change of variables, in derivatives, 
91 

in integrals, 124, 147, 155, 199 
Circular functions, 308 
Closed curve, area of, 178 
simple, 179 

Comparison test for series, 215 
Complex number, 3 
Conditionally convergent series, 236 
Conservative systems, 204 
Continuity, 31, 35, 39, 58, 256, 276 
equation of, 206 
piece-wise, 34 
uniform, 37, 38, 60 
Convergence, 11 

absolute, 236, 240, 263, 268, 337, 
341, 344 

criterion, 13, 14, 20, 210, 233 
of integrals, 337, 341 
tests for, 341, 349, 367 
interval of, 248, 267, 269 
radius of, 269 
of series, 209, 247 
tests for, 215, 225, 237, 262 
uniform, 247, 263, 264, 355, 367, 
408 

Coordinate surfaces, 155 
Coordinates, curvilinear, 148 
cylindrical, 157 
polar, 148, 152, 167 
spherical, 157 
Curve, simple, 179 
Curvilinear coordinates, 148 
Cut, 2 

Cylindrical coordinates, 157 
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D’Alembert^s ratio test, 217 
Darboux theorem, 108 
Dedekind, 2, 3 
Definite integrals, 99-129 
applications of, 126 
change of variables in, 124 
differentiation tinder sign of, 121 
evaluation of, 110, 118, 123, 144, 
178, 309 

mean-value theorems on, 113 
Density, property of, 1 
Dependence, functional, 423, 433 
Derivatives, 41, 47 
of composite functions, 45, 67, 71, 
439 

directional, 76, 86, 87 
of higher order, 87 
of implicit functions, 68, 71, 89, 
426 

of integrals, 119, 121 
normal, 78, 86, 87 
partial, 62 
of series, 261, 405 
Differentials, 43 
exact, 191, 199 

{See also Total differential) 
of higher order, 47 
total, 64 

Differentiation, of composite func¬ 
tions, 46, 67, 71, 439 
of implicit functions, 68, 71 
{See also Implicit functions) 
under integral sign, 121, 353, 367, 
371 

inversion of the order, 87 
of series, 261, 405 
Direction angles, 80 
Direction components, 80 
Direction cosines, 81, 162 
Directional derivative, 76, 86 
{See also Gradient) 

Dirichlet^s conditions, 384, 385 
Dirichlet's integral, 387, 362 
Discontinuities, 34, 392 
Divergence theorem, 167 


Double integrals, 130 
improper, 365 
Double series, 246 
convergence of, 247 

E 

c, base of natural logarithms, 28 
Ellipse, length of, 314 
Elliptic integrals, 117, 129, 312, 313, 
352 

Errors, approximate, 66 
relative, 66 
Euler^s formulas, 306 
Euler’s theorem, 75 
Evaluation of integrab, 110, 118, 
123, 131, 144, 178, 310, 357 
Even function, 391 
Exact differentials, 191, 199 
Exbtence theorem, for implicit func¬ 
tions, 425 

for simultaneous equations, 430 
Expansion, in Maclaurin’s series, 298 
in power series, 290, 291, 298 
in series of orthogonal functions, 
389 

in Taylor’s series, 298 
in trigonometric series, 389 
(See also Fourier series) 
Extended law of the mean, 291 
Extremal values, 327, 332 


Factorial, generali;sation of {see 
Gamma functions) 

Fermat’s theorem, 49 
Fl\iid motion, 204 

Force of attraction, 172, 202, 369, 
372 

Fourier coefficients, 380, 389 
Fourier integral, 409, 413 
equation, 413 
Fourier series, 862-414 
complex form of, 403, 405 
differentiation of, 405 
expansion in, 390 
integration of, 405, 409 
uniform convergence of, 408 
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Fresnel's integrals, 365 
Function, 22, 58, 321 
bounds of, 106 
composite, 45, 47, 439 
continuity of, 31, 35, 39, 69, 392 
differentiable, 43 
even, 391 
homogeneous, 75 
implicit, 68, 415-440 
integrable, 109, 110, 335n. 
jump in, 34 
multiple-valued, 22 
normal, 388 
odd, 391 
orthogonal, 388 
periodic, 379n. 
piece-wise continuous, 34 
sectionally continuous, 34 
single-valued, 22 
uniformly continuous, 38 
Functional dependence, 423, 433 
Functional determinant, 153, 157, 
167, 200, 421, 438 

Fundamental theorem of integral 
calculus, 110, 118, 120 

G 

Gamma functions, 372 
Gauss's test for series, 230 
Gauss's theorem, 169/1. 

Geometric series, 214 
Gradient, 78 

Gravitational potential {see Poten¬ 
tial) 

Gravity, center of, 137, 159, 165 
Greenes theorem, 167, 170, 172, 181 


Helix, 86, 86 

Homogeneous functions, 75 
Hyperbolic functions, 306 
Hyperbolic paraboloid, 325 


Implicit functions, 68, 415-440 
differentiation of, 71, 416 
existence theorem on, 425 
higher derivatives of, 89 


Improper integrals, 335-377 
multiple, 365 
Indefinite integrals, 119 
Indeterminate forms, 54 
Induction, mathematical, 9, 431 
Infinite integrals, 335, 347 
tests for convergence of, 341, 349, 
367 

{See also -Improper integrals) 
Infinite series, 209-266 
absolute convergence of, 236, 240, 
263, 268 

addition of, 212, 240, 281 
alternating, 234 
of arbitrary terms, 233 
conditional convergence of, 236 
convergence of, 209, 233, 236 
differentiation of, 261 
division of, 285 
double, 246 
expansion in, 298, 383 
of functions, 247, 275 
geometric, 214 
integration of, 258, 309 
multiplication of, 242, 281 
of orthogonal functions, 389 
of positive terms, 233 
of power functions, 267-334 
algebra, 280 
applications, 291-334 
calculations with, 285 
expansion in, 291 
integration, 309 
reversion, 289 
tests for convergence, 269 
uniqueness theorem on, 279 
remainder in, 234 
sum of, 209, 395 

tests for convergence, 215, 225 
237, 262, 269 

uniform convergence of, 247, 252, 
275 

{See also Fourier series) 
Infinitesimal, 64n. 

Infinity, 16 

Integrable function, 109, 385n. 
Integral equation, 413 
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Integral test for series, 225 
Integrals, applications of, 126, 199 
change of variables in, 124, 147, 
155, 199 

containing parameters, 121, 353 
of Dirichlet, 387, 362 
definite, 99, 101 
differentiation of, 121, 353 
divergent, 335 

elliptic, 117, 129, 312, 313, 352 
evaluation of, 110, 118, 123, 131, 
144, 178, 310, 357 
of Fourier, 409, 413 
improper, or infinite, 335, 365 
{See also Improper integrals) 
indefinite, 119 
integration under sign, 353 
line, 174 

multiple, 130, 139, 142 
Biemannian, 104 
surface, 161, 196 
tests for convergence, 341 
transformation of {see Greenes 
theorem; Stokes's theorem) 
uniform convergence of, 355, 367 
Integration, of Fourier series, 405 
under integral sign, 353 
by parts, 353 
region of, 131 
in series, 309 
of series, 258, 309 

Interchange of order of differentia¬ 
tion, 87 

Intervals, Abel's theorem on, 268 
of convergence, 248, 267, 269 
extension of, 401 
open and closed, 22 
Inverse transformations, 421 
Inversion transformation, 440 
Iterated integrals, 136 


Jacobians, 150, 153, 157, 167, 200, 
421 

properties of, 438 
Jump in function, 34 


K 

Kximmer's test, 228 
L 

Lagrange's multipliers, 329, 331 
Lagrangian form of remainder, 292 
Laplace's equation, 208, 372 
Law of the mean, 291 

{See also Mean-value theorem) 
Leibnitz's theorem on series, 234 
Lemniscate, 128 
Length of curve, 127 
L'Hospital's rule, 54 
Liapunoff, A., 383 
Limiting points, 17 
Limits, 6, 16, 58 
existence of, 10 
of functions, 23 
iterated, 61 

left- and right-hand, 24 
repeated, 61 
theorems on, 26 
upper and lower, 16, 18 
line integrals, 174-208 
applications of, 171, 199 
properties of, 185, 198 
in space, 195 

transformation of, 181, 196 
Logarithm, base of, 10, 28, 31 
Logarithmic spiral, 128 
Lower bound, 22, 23, 106 

M 

Maclaurin's formula, 295, 318, 320 
Maclaurin's series, 290 
Maxima and minima, 315, 321, 327, 
332 

Mean-value theorem, 51 

{See ako Law of the mean) 
Mean-value theorems for integrals, 
113, 115, 131 
Mertens, F., 244 

Minima (see Maxima and minima) 
Minimax, 326 

Moment of inertia, 138, 145, 151, 
160, 166 



INDEX 


445 


Monotonicity, 14, 15 
Multiple integrals, 130, 139, 142 
improper, 365 

Multiplication of series, 244 
Multiply connected regions, 184,192 

N 

Neighborhood, 8 

Newton^s law of attraction, 172, 202 
Newtonian potential, 172, 203, 370 
Normal derivative, 78, 86, 87 
Normal line, 80 

Normal orthogonal functions, 388 
Number system, 2 
Numbers, 1 
complex, 3 
rational, 1 
real, 2 


Odd function, 391 
Order of, 406 
Ordering, 1 

Orthogonal functions, 388 
Ostrogradsky's theorem, 169n. 


Parameter, integrals containing, 121 
Partial derivatives, 62 
Partial sums, 209, 248 
Partition, 2 

Periodic function, 379n. 

Plane, tangent, 80 
Points of condensation, 17 
Polar coordinates, 148, 152, 157 
Potential, 172, 203, 206, 370 
Power series, 267-290 
applications of, 291-334 
Primitive, 119 

Principal part of increment, 64 
Probability integral, 357 


R 

Raabe's test, 230n., 233, 303n. 
Radius of convergence, 269 
Ratio test, 217, 220, 237 
Rearrangement of series, 240 
Regions, simply and multiply con¬ 
nected, 184, 192, 196 
Remainder, 234 
in Taylor^s series, 292, 293 
Riemann integral, 99 
upper and lower, 108 
Riemann zeta-function, 364, 365 
Rollers theorem, 50 
Root test, 216, 220, 237 

S 

Schwarz’s theorem, 87 
Sequences, 3 
bounded, 5 
convergent, 6, 14 
divergent, 16 
limiting pc^ts of, 17 
limits of, 6 
monotone, 14 
null, 5 

Series {see Fourier series; Infinite 
series) 

Simply connected regions, 184, 196 
Simultaneous equations, existence 
theorem for, 430 
Sine and cosine series, 397 
Solid angle, 171 
Space curve, 83 

equation of tangent to, 85 
length of, 86 

Spherical coordinates, 157 
Spiral, logarithmic, 128 
Stokes’s theorem, 196 
Stream function, 206 
Summation of series, 395 
Surface integrals, 161, 196 
Surface of revolution, 128 


Tangent line, 70 
Tangent plane, 80 


Quotient of power series, 282 
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Taylor^s formula, 292, 293, 317 
applications of, 298, 322 
Taylor’s series, 296 
Tests, for integrals, 341, 349, 367 
for series, 215, 225, 237, 262, 264 
Total differential, 64 

{See also Exact differential) 
Transformation, of coordinates, 153 
of integrals, 167, 170, 172, 181, 
196 

of inversion, 440 

Trigonometric series (see Fourier 
series) 

Triple integrals, 142 
improper, 367 

U 

Undetermined multipliers, 328 
Uniform continuity, 37, 60 
Uniform convergence, of integrals, 
355, 367 

of series, M7, 262, 264, 408 


Upper bound, 23 
of a function, 106 

V 

Velocity potential, 206 

Vicinity, 8 

Volume, element of, 156, 158, 159 
of revolution, 128, 143, 155 

W 

Wallis’s formula, 311 

Weierstrass test, for integrals, 356 
for series, 262 

Work, as a line integral, 201 

Y 

Young’s theorem, 89n. 

Z 


Zeta-function, 364, 365 




